Searched refs:Rounded (Results 1 – 25 of 62) sorted by relevance
123
40 pwsx001 power 1 0.5 -> 1.00000000 Inexact Rounded42 pwsx003 power 1.00 0.5 -> 1.00000000 Inexact Rounded53 pwsx013 power 2 0.5 -> 1.41421356 Inexact Rounded55 pwsx015 power 2.00 0.5 -> 1.41421356 Inexact Rounded67 pwsx027 power 4.0 0.5 -> 2.00000000 Inexact Rounded68 pwsx028 power 4.00 0.5 -> 2.00000000 Inexact Rounded70 pwsx030 power +0.1 0.5 -> 0.316227766 Inexact Rounded72 pwsx032 power +0.01 0.5 -> 0.100000000 Inexact Rounded74 pwsx034 power +0.001 0.5 -> 0.0316227766 Inexact Rounded76 pwsx036 power +0.000001 0.5 -> 0.00100000000 Inexact Rounded[all …]
42 sqtx013 squareroot 2 -> 1.41421356 Inexact Rounded44 sqtx015 squareroot 2.00 -> 1.41421356 Inexact Rounded59 sqtx030 squareroot +0.1 -> 0.316227766 Inexact Rounded63 sqtx034 squareroot +0.001 -> 0.0316227766 Inexact Rounded70 sqtx041 squareroot 1.1 -> 1.04880885 Inexact Rounded71 sqtx042 squareroot 1.10 -> 1.04880885 Inexact Rounded72 sqtx043 squareroot 1.100 -> 1.04880885 Inexact Rounded73 sqtx044 squareroot 1.110 -> 1.05356538 Inexact Rounded78 sqtx049 squareroot 9.9 -> 3.14642654 Inexact Rounded79 sqtx050 squareroot 9.90 -> 3.14642654 Inexact Rounded[all …]
43 radx100 add 12345 -0.1 -> 12344 Inexact Rounded44 radx101 add 12345 -0.01 -> 12344 Inexact Rounded45 radx102 add 12345 -0.001 -> 12344 Inexact Rounded46 radx103 add 12345 -0.00001 -> 12344 Inexact Rounded47 radx104 add 12345 -0.000001 -> 12344 Inexact Rounded48 radx105 add 12345 -0.0000001 -> 12344 Inexact Rounded50 radx107 add 12345 0.0000001 -> 12345 Inexact Rounded51 radx108 add 12345 0.000001 -> 12345 Inexact Rounded52 radx109 add 12345 0.00001 -> 12345 Inexact Rounded53 radx110 add 12345 0.0001 -> 12345 Inexact Rounded[all …]
32 lnxs003 ln 2.71828183 -> 1.00000000 Inexact Rounded33 lnxs004 ln 10 -> 2.30258509 Inexact Rounded40 lnx0002 ln 1E-9 -> -20.72326583694641 Inexact Rounded41 lnx0003 ln 0.0007 -> -7.264430222920869 Inexact Rounded42 lnx0004 ln 0.1 -> -2.302585092994046 Inexact Rounded43 lnx0005 ln 0.7 -> -0.3566749439387324 Inexact Rounded46 lnx0008 ln 1.5 -> 0.4054651081081644 Inexact Rounded47 lnx0009 ln 2 -> 0.6931471805599453 Inexact Rounded48 lnx0010 ln 2.718281828459045 -> 0.9999999999999999 Inexact Rounded49 lnx0011 ln 2.718281828459046 -> 1.000000000000000 Inexact Rounded[all …]
33 expx002 exp -10 -> 0.0000453999298 Inexact Rounded34 expx003 exp -1 -> 0.367879441 Inexact Rounded37 expx006 exp 1 -> 2.71828183 Inexact Rounded38 expx007 exp 0.693147181 -> 2.00000000 Inexact Rounded39 expx008 exp 10 -> 22026.4658 Inexact Rounded44 expx011 exp 0.1 -> 1.105171 Inexact Rounded45 expx012 exp 0.01 -> 1.010050 Inexact Rounded46 expx013 exp 0.001 -> 1.001001 Inexact Rounded47 expx014 exp 0.0001 -> 1.000100 Inexact Rounded48 expx015 exp 0.00001 -> 1.000010 Inexact Rounded[all …]
36 logxs003 log10 2 -> 0.301029996 Inexact Rounded38 logxs005 log10 70 -> 1.84509804 Inexact Rounded45 logx0001 log10 7E-1000 -> -999.1549019599857 Inexact Rounded46 logx0002 log10 1.1E-9 -> -8.958607314841775 Inexact Rounded47 logx0003 log10 0.0007 -> -3.154901959985743 Inexact Rounded48 logx0004 log10 0.11 -> -0.9586073148417750 Inexact Rounded49 logx0005 log10 0.7 -> -0.1549019599857432 Inexact Rounded51 logx0007 log10 1.5 -> 0.1760912590556812 Inexact Rounded52 logx0008 log10 2 -> 0.3010299956639812 Inexact Rounded53 logx0009 log10 2.718281828459045 -> 0.4342944819032518 Inexact Rounded[all …]
30 xadd001 add 905.67402 -202896611.E-780472620 -> 905.674020 Inexact Rounded32 xdiv001 divide 905.67402 -202896611.E-780472620 -> -4.46372177E+780472614 Inexact Rounded34 xmul001 multiply 905.67402 -202896611.E-780472620 -> -1.83758189E-780472609 Inexact Rounded35 xpow001 power 905.67402 -2 -> 0.00000121914730 Inexact Rounded37 xsub001 subtract 905.67402 -202896611.E-780472620 -> 905.674020 Inexact Rounded38 xadd002 add 3915134.7 -597164907. -> -593249772 Inexact Rounded40 xdiv002 divide 3915134.7 -597164907. -> -0.00655620358 Inexact Rounded42 xmul002 multiply 3915134.7 -597164907. -> -2.33798105E+15 Inexact Rounded43 xpow002 power 3915134.7 -597164907 -> 0E-1000000007 Underflow Subnormal Inexact Rounded Clamped45 xsub002 subtract 3915134.7 -597164907. -> 601080042 Inexact Rounded[all …]
32 …2579 0218.932010396534371704930714860E+797 -> 2.189320103965343717049307148600E+799 Inexact Rounded34 …2579 0218.932010396534371704930714860E+797 -> 2.262681764507965005284080800438E-787 Inexact Rounded36 …2579 0218.932010396534371704930714860E+797 -> 1.084531091568672041923151632066E+812 Inexact Rounded37 …wx3001 power 4953734675913.065314738743322579 2 -> 24539487239343522246155890.99495 Inexact Rounded39 …579 0218.932010396534371704930714860E+797 -> -2.189320103965343717049307148600E+799 Inexact Rounded40 …44 -78864532047.12287484430980636798E+934 -> -7.886453204712287484430980636798E+944 Inexact Rounded42 …4 -78864532047.12287484430980636798E+934 -> -1.222562801441069667849402782716E-1785 Inexact Rounded44 …44 -78864532047.12287484430980636798E+934 -> -7.603869223099928141659831589905E+104 Inexact Rounded45 … 9641.684323386955881595490347910E-844 -8 -> 1.338988152067180337738955757587E+6720 Inexact Rounded47 …844 -78864532047.12287484430980636798E+934 -> 7.886453204712287484430980636798E+944 Inexact Rounded[all …]
30 inx003 add 123456789 0.0 -> 123456789 Rounded31 inx004 add 123456789 0.00 -> 123456789 Rounded33 inx006 add 123456789 0.1 -> 123456789 Inexact Rounded34 inx007 add 123456789 0.01 -> 123456789 Inexact Rounded35 inx008 add 123456789 0.001 -> 123456789 Inexact Rounded36 inx009 add 123456789 0.000001 -> 123456789 Inexact Rounded37 inx010 add 123456789 0.000000001 -> 123456789 Inexact Rounded38 inx011 add 123456789 0.000000000001 -> 123456789 Inexact Rounded40 inx012 add 123456789 0.9 -> 123456790 Inexact Rounded41 inx013 add 123456789 0.09 -> 123456789 Inexact Rounded[all …]
60 powx027 power '2' '31' -> '2.14748365E+9' Inexact Rounded62 powx028 power '2' '32' -> '4.29496730E+9' Inexact Rounded99 powx061 power '10' '9' -> 1.00000000E+9 Rounded100 powx062 power '10' '22' -> 1.00000000E+22 Rounded101 powx063 power '10' '77' -> 1.00000000E+77 Rounded102 powx064 power '10' '99' -> 1.00000000E+99 Rounded128 powx093 power 101 5 -> 1.05101005E+10 Inexact Rounded129 powx094 power 101 6 -> 1.06152015E+12 Inexact Rounded130 powx095 power 101 7 -> 1.07213535E+14 Inexact Rounded134 powx100 power '3' '-1' -> 0.333333333 Inexact Rounded[all …]
44 ddadd011 add '0.4444444444444446' '0.5555555555555555' -> '1.000000000000000' Inexact Rounded45 ddadd012 add '0.4444444444444445' '0.5555555555555555' -> '1.000000000000000' Rounded47 ddadd014 add '4444444444444444' '0.49' -> '4444444444444444' Inexact Rounded48 ddadd015 add '4444444444444444' '0.499' -> '4444444444444444' Inexact Rounded49 ddadd016 add '4444444444444444' '0.4999' -> '4444444444444444' Inexact Rounded50 ddadd017 add '4444444444444444' '0.5000' -> '4444444444444444' Inexact Rounded51 ddadd018 add '4444444444444444' '0.5001' -> '4444444444444445' Inexact Rounded52 ddadd019 add '4444444444444444' '0.501' -> '4444444444444445' Inexact Rounded53 ddadd020 add '4444444444444444' '0.51' -> '4444444444444445' Inexact Rounded72 ddadd035 add '70' '10000e+16' -> '1.000000000000000E+20' Inexact Rounded[all …]
36 ddqua003 quantize 0.1 1e+2 -> 0E+2 Inexact Rounded37 ddqua005 quantize 0.1 1e+1 -> 0E+1 Inexact Rounded38 ddqua006 quantize 0.1 1e0 -> 0 Inexact Rounded42 ddqua010 quantize 0.9 1e+2 -> 0E+2 Inexact Rounded43 ddqua011 quantize 0.9 1e+1 -> 0E+1 Inexact Rounded44 ddqua012 quantize 0.9 1e+0 -> 1 Inexact Rounded51 ddqua023 quantize -0.1 1e+2 -> -0E+2 Inexact Rounded52 ddqua025 quantize -0.1 1e+1 -> -0E+1 Inexact Rounded53 ddqua026 quantize -0.1 1e0 -> -0 Inexact Rounded57 ddqua030 quantize -0.9 1e+2 -> -0E+2 Inexact Rounded[all …]
38 dqqua003 quantize 0.1 1e+2 -> 0E+2 Inexact Rounded39 dqqua005 quantize 0.1 1e+1 -> 0E+1 Inexact Rounded40 dqqua006 quantize 0.1 1e0 -> 0 Inexact Rounded44 dqqua010 quantize 0.9 1e+2 -> 0E+2 Inexact Rounded45 dqqua011 quantize 0.9 1e+1 -> 0E+1 Inexact Rounded46 dqqua012 quantize 0.9 1e+0 -> 1 Inexact Rounded53 dqqua023 quantize -0.1 1e+2 -> -0E+2 Inexact Rounded54 dqqua025 quantize -0.1 1e+1 -> -0E+1 Inexact Rounded55 dqqua026 quantize -0.1 1e0 -> -0 Inexact Rounded59 dqqua030 quantize -0.9 1e+2 -> -0E+2 Inexact Rounded[all …]
44 …6' '0.5555555555555555555555555555555555' -> '1.000000000000000000000000000000000' Inexact Rounded45 …444444445' '0.5555555555555555555555555555555555' -> '1.000000000000000000000000000000000' Rounded47 …444444444444444444444444444444444' '0.49' -> '4444444444444444444444444444444444' Inexact Rounded48 …444444444444444444444444444444444' '0.499' -> '4444444444444444444444444444444444' Inexact Rounded49 …444444444444444444444444444444444' '0.4999' -> '4444444444444444444444444444444444' Inexact Rounded50 …444444444444444444444444444444444' '0.5000' -> '4444444444444444444444444444444444' Inexact Rounded51 …444444444444444444444444444444444' '0.5001' -> '4444444444444444444444444444444445' Inexact Rounded52 …444444444444444444444444444444444' '0.501' -> '4444444444444444444444444444444445' Inexact Rounded53 …444444444444444444444444444444444' '0.51' -> '4444444444444444444444444444444445' Inexact Rounded72 dqadd035 add '70' '10000e+34' -> '1.000000000000000000000000000000000E+38' Inexact Rounded[all …]
40 addx011 add '0.4444444444' '0.5555555555' -> '1.00000000' Inexact Rounded41 addx012 add '0.4444444440' '0.5555555555' -> '1.00000000' Inexact Rounded42 addx013 add '0.4444444444' '0.5555555550' -> '0.999999999' Inexact Rounded43 addx014 add '0.44444444449' '0' -> '0.444444444' Inexact Rounded44 addx015 add '0.444444444499' '0' -> '0.444444444' Inexact Rounded45 addx016 add '0.4444444444999' '0' -> '0.444444444' Inexact Rounded46 addx017 add '0.4444444445000' '0' -> '0.444444445' Inexact Rounded47 addx018 add '0.4444444445001' '0' -> '0.444444445' Inexact Rounded48 addx019 add '0.444444444501' '0' -> '0.444444445' Inexact Rounded49 addx020 add '0.44444444451' '0' -> '0.444444445' Inexact Rounded[all …]
37 intxx003 tointegralx 0.1 -> 0 Inexact Rounded38 intxx004 tointegralx 0.2 -> 0 Inexact Rounded39 intxx005 tointegralx 0.3 -> 0 Inexact Rounded40 intxx006 tointegralx 0.4 -> 0 Inexact Rounded41 intxx007 tointegralx 0.5 -> 1 Inexact Rounded42 intxx008 tointegralx 0.6 -> 1 Inexact Rounded43 intxx009 tointegralx 0.7 -> 1 Inexact Rounded44 intxx010 tointegralx 0.8 -> 1 Inexact Rounded45 intxx011 tointegralx 0.9 -> 1 Inexact Rounded47 intxx013 tointegralx 1.0 -> 1 Rounded[all …]
44 ddintx003 tointegralx 0.1 -> 0 Inexact Rounded45 ddintx004 tointegralx 0.2 -> 0 Inexact Rounded46 ddintx005 tointegralx 0.3 -> 0 Inexact Rounded47 ddintx006 tointegralx 0.4 -> 0 Inexact Rounded48 ddintx007 tointegralx 0.5 -> 0 Inexact Rounded49 ddintx008 tointegralx 0.6 -> 1 Inexact Rounded50 ddintx009 tointegralx 0.7 -> 1 Inexact Rounded51 ddintx010 tointegralx 0.8 -> 1 Inexact Rounded52 ddintx011 tointegralx 0.9 -> 1 Inexact Rounded54 ddintx013 tointegralx 1.0 -> 1 Rounded[all …]
44 dqintx003 tointegralx 0.1 -> 0 Inexact Rounded45 dqintx004 tointegralx 0.2 -> 0 Inexact Rounded46 dqintx005 tointegralx 0.3 -> 0 Inexact Rounded47 dqintx006 tointegralx 0.4 -> 0 Inexact Rounded48 dqintx007 tointegralx 0.5 -> 0 Inexact Rounded49 dqintx008 tointegralx 0.6 -> 1 Inexact Rounded50 dqintx009 tointegralx 0.7 -> 1 Inexact Rounded51 dqintx010 tointegralx 0.8 -> 1 Inexact Rounded52 dqintx011 tointegralx 0.9 -> 1 Inexact Rounded54 dqintx013 tointegralx 1.0 -> 1 Rounded[all …]
84 fma0201 fma 888565290 1557.96930 -86087.7578 -> 1.38435736E+12 Inexact Rounded86 fma0205 fma -85519342.9 735155419 42010431 -> -6.28700083E+16 Inexact Rounded88 fma0208 fma -98025.5 -294603.472 10414348.2 -> 2.88890670E+10 Inexact Rounded90 fma0211 fma 5967627.39 83526540.6 498494.810 -> 4.98455272E+14 Inexact Rounded92 fma0216 fma 3456.9433 874.39518 197866.615 -> 3220601.17 Inexact Rounded94 fma0218 fma 62769.8287 2096.98927 48.420317 -> 131627706 Inexact Rounded96 fma0219 fma -68.81500 59961113.9 -8988862 -> -4.13521292E+9 Inexact Rounded98 fma0226 fma 2126341.02 63491.5152 302427455 -> 1.35307041E+11 Inexact Rounded141 fmax2013 fma 1.23456789 1.00000000 0E+999999 -> 1.23456789 Rounded142 fmax2014 fma 9.999999999 9.999999999 0E+999999 -> 100.000000 Inexact Rounded[all …]
73 subx052 subtract '0.5555555559' '0.0000000001' -> '0.555555556' Inexact Rounded74 subx053 subtract '0.5555555559' '0.0000000005' -> '0.555555555' Inexact Rounded75 subx054 subtract '0.4444444444' '0.1111111111' -> '0.333333333' Inexact Rounded76 subx055 subtract '1.0000000000' '0.00000001' -> '0.999999990' Rounded77 subx056 subtract '0.4444444444999' '0' -> '0.444444444' Inexact Rounded78 subx057 subtract '0.4444444445000' '0' -> '0.444444445' Inexact Rounded80 subx060 subtract '70' '10000e+9' -> '-1.00000000E+13' Inexact Rounded81 subx061 subtract '700' '10000e+9' -> '-1.00000000E+13' Inexact Rounded82 subx062 subtract '7000' '10000e+9' -> '-9.99999999E+12' Inexact Rounded83 subx063 subtract '70000' '10000e+9' -> '-9.99999993E+12' Rounded[all …]
36 resx003 rescale 0.1 +2 -> 0E+2 Inexact Rounded37 resx005 rescale 0.1 +1 -> 0E+1 Inexact Rounded38 resx006 rescale 0.1 0 -> 0 Inexact Rounded42 resx010 rescale 0.9 +2 -> 0E+2 Inexact Rounded43 resx011 rescale 0.9 +1 -> 0E+1 Inexact Rounded44 resx012 rescale 0.9 +0 -> 1 Inexact Rounded51 resx023 rescale -0.1 +2 -> -0E+2 Inexact Rounded52 resx025 rescale -0.1 +1 -> -0E+1 Inexact Rounded53 resx026 rescale -0.1 0 -> -0 Inexact Rounded57 resx030 rescale -0.9 +2 -> -0E+2 Inexact Rounded[all …]
36 dddiv007 divide 1 3 -> 0.3333333333333333 Inexact Rounded37 dddiv008 divide 2 3 -> 0.6666666666666667 Inexact Rounded92 dddiv060 divide 1 7 -> 0.1428571428571429 Inexact Rounded93 dddiv061 divide 1.2345678 1.9876543 -> 0.6211179680490717 Inexact Rounded127 dddiv102 divide 1 3 -> 0.3333333333333333 Inexact Rounded130 dddiv105 divide 1 6 -> 0.1666666666666667 Inexact Rounded131 dddiv106 divide 1 7 -> 0.1428571428571429 Inexact Rounded133 dddiv108 divide 1 9 -> 0.1111111111111111 Inexact Rounded149 dddiv130 divide 12345 4.999 -> 2469.493898779756 Inexact Rounded150 dddiv131 divide 12345 4.99 -> 2473.947895791583 Inexact Rounded[all …]
83 …5.85969 35892634447236753.172812 -> 4.500119002100000209469729375698779E+38 Inexact Rounded85 …3336.89 5061036497288796076266.11 -> 5.996248469584594346858881620185513E+41 Inexact Rounded87 ….984448 3205615239077711589912.85 -> 1.899242968678256924021594770874071E+34 Inexact Rounded89 …9002.80 47533279819997167655440 -> 7.078596978842809537929699954860308E+37 Inexact Rounded91 …9.55407 217117438419590824502.963 -> 1.224955667581427559754106862350744E+37 Inexact Rounded93 …717435 53682082598315949425.937 -> -2.530094043253148806272276368579143E+42 Inexact Rounded95 …9205581 83578980278690395184.620 -> 1.713387085759711954319391412788453E+37 Inexact Rounded97 ….477249 70179636544416756129546 -> 4.062275663405823716411579117771548E+35 Inexact Rounded99 …9266598 78563844650942419311830.8 -> 6.002604327732568490562249875306822E+47 Inexact Rounded101 …216.62 57665666816652967150473.5 -> -2.027022514381452197510103395283873E+39 Inexact Rounded[all …]
83 … 27583489.6645 2582471078.04 2593183.42371 -> 7.123356429257970E+16 Inexact Rounded85 … 24280.355566 939577.397653 2032.013252 -> 22813275328.80507 Inexact Rounded87 … 7848976432 -2586831.2281 137903.517909 -> -2.030397734278061E+16 Inexact Rounded89 … 56890.388731 35872030.4255 339337.123410 -> 2040774094814.078 Inexact Rounded91 … 7533543.57445 360317763928 5073392.31638 -> 2.714469575205050E+18 Inexact Rounded93 … 739945255.563 13672312784.1 -994381.53572 -> 1.011676297716715E+19 Inexact Rounded95 … -413510957218 704729988550 9234162614.0 -> -2.914135721455314E+23 Inexact Rounded97 … 437484.00601 598906432790 894450638.442 -> 2.620119863365787E+17 Inexact Rounded99 … 73287556929 173651305.784 -358312568.389 -> 1.272647995808177E+19 Inexact Rounded101 … 203258304486 -8628278.8066 153127.446727 -> -1.753769320861850E+18 Inexact Rounded[all …]
36 quax003 quantize 0.1 1e+2 -> 0E+2 Inexact Rounded37 quax005 quantize 0.1 1e+1 -> 0E+1 Inexact Rounded38 quax006 quantize 0.1 1e0 -> 0 Inexact Rounded42 quax010 quantize 0.9 1e+2 -> 0E+2 Inexact Rounded43 quax011 quantize 0.9 1e+1 -> 0E+1 Inexact Rounded44 quax012 quantize 0.9 1e+0 -> 1 Inexact Rounded51 quax023 quantize -0.1 1e+2 -> -0E+2 Inexact Rounded52 quax025 quantize -0.1 1e+1 -> -0E+1 Inexact Rounded53 quax026 quantize -0.1 1e0 -> -0 Inexact Rounded57 quax030 quantize -0.9 1e+2 -> -0E+2 Inexact Rounded[all …]