Searched refs:precisions (Results 1 – 11 of 11) sorted by relevance
| /device/linaro/bootloader/edk2/AppPkg/Applications/Python/Python-2.7.2/Tools/unicode/ |
| D | gencodec.py | 136 def python_mapdef_code(varname, map, comments=1, precisions=(2, 4)): argument
154 key_precision, value_precision = precisions
268 precisions=(4, 2))
|
| /device/linaro/bootloader/edk2/StdLib/LibC/Softfloat/ |
| D | softfloat.txt | 36 limited to only single and double precisions. When that is the case, all
222 precisions.
|
| /device/linaro/bootloader/edk2/AppPkg/Applications/Python/Python-2.7.2/Lib/test/decimaltestdata/ |
| D | compare.decTest | 572 -- precisions above or below the difference should have no effect
|
| D | comparetotal.decTest | 567 -- precisions above or below the difference should have no effect
|
| D | comparetotmag.decTest | 559 -- precisions above or below the difference should have no effect
|
| D | exp.decTest | 354 -- basics at low precisions
|
| D | multiply.decTest | 560 -- 'subnormal' test edge condition at higher precisions
|
| D | rounding.decTest | 1025 -- check maximum finite value over a range of precisions
|
| D | randomBound32.decTest | 22 -- These testcases test calculations at precisions 31, 32, and 33, to
|
| D | fma.decTest | 637 -- 'subnormal' test edge condition at higher precisions
|
| D | squareroot.decTest | 3348 -- precisions 2; all cases where result is both subnormal and a tie
|