Lines Matching refs:fraction

11 fractions.  For example, the decimal fraction ::
15 has value 1/10 + 2/100 + 5/1000, and in the same way the binary fraction ::
28 The problem is easier to understand at first in base 10.  Consider the fraction
29 1/3.  You can approximate that as a base 10 fraction::
46 decimal value 0.1 cannot be represented exactly as a base 2 fraction.  In base
47 2, 1/10 is the infinitely repeating fraction ::
55 number ``0.1`` is the binary fraction ::
62 decimal fraction, because of the way that floats are displayed at the
98 to the nearest value, rounding ties away from zero.  Since the decimal fraction
165 fraction. Almost all machines today (July 2010) use IEEE-754 floating point
168 strives to convert 0.1 to the closest fraction it can of the form *J*/2**\ *N*
209 So the computer never "sees" 1/10:  what it sees is the exact fraction given
215 If we multiply that fraction by 10\*\*30, we can see the (truncated) value of
225 based on the shortest decimal fraction that rounds correctly back to the true