Searched refs:precisionBits (Results 1 – 1 of 1) sorted by relevance
12 def fixedToFloat(value, precisionBits): argument28 scale = 1 << precisionBits31 digits = (precisionBits + 2) // 346 def floatToFixed(value, precisionBits): argument60 return int(round(value * (1<<precisionBits)))