AriasCreations/LSL-PyOptimizer
3
0
Fork 0
mirror of https://github.com/Sei-Lisa/LSL-PyOptimizer synced 2025-07-22 20:49:33 -07:00
Code Issues Projects Releases Packages Wiki Activity Actions

Fix threshold value for denormal to be taken as 0

Browse source 
(float)"1.1754944e-38" is != 0
(float)"1.1754943e-38" is == 0

Yet, 1.1754944e-38 == 1.1754943e-38.

The fix is to perform the operations as doubles, and convert to F32 *after* comparing the denormal range.
This commit is contained in:
Sei Lisa 2018-04-27 23:44:27 +02:00
parent 1afe1643c0
commit 091f06cccc
1 changed files with 3 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

6
lslopt/lslbasefuncs.py
View file

@ -456,18 +456,18 @@ def InternalTypecast(val, out, InList, f32):
if match is None:
return 0.0
if match.group(1):
ret = F32(float.fromhex(match.group(0)), f32)
ret = float.fromhex(match.group(0))
elif match.group(2):
# (float)"-nan" produces NaN instead of Indet, even though
# (vector)"<-nan,0,0>" produces <Indet, 0., 0.>. Go figure.
ret = NaN
else:
ret = F32(float(match.group(0)), f32)
ret = float(match.group(0))
if not lslcommon.LSO and abs(ret) < 1.1754943508222875e-38:
# Mono doesn't return denormals when using (float)"val"
# (but it returns them when using (vector)"<val,...>")
ret = 0.0
return ret
return F32(ret, f32)
if out == int:
match = int_re.search(val)
if match is None: