Searched defs:ulp (Results 1 – 4 of 4) sorted by relevance
389 double ulp = Float16Utils.float16Ulp(value); in validateFloat16Ulp() local534 double ulp = Float16Utils.float16Ulp(value); in testRoundToFloat16() local
131 half ulp; in getErrorBar() local
434 double ulp = NegativeUlp(); in ExpandMin() local475 double ulp = Ulp(); in ExpandMax() local
52 float ulp = Math.ulp(ref[refIdx]) * ulpCount; in checkArray() local