Precision problem
Mobile
4
Posts
2
Posters
0
Views
1
Watching
-
-
environment: Microsoft eVC4 with SDK 4.0 (WCE emulator) double C = 7*pow(16,14); the result is 504403158265495552 in WCE Emulator or my ARM-based PPC.. however, under other platform(x86), the result is 50440315826549555"0" does anyone know what's wrong?
I just tested it under the desktop's calc.exe and the result is
504403158265495552. In what other platforms have you tested this? -
I just tested it under the desktop's calc.exe and the result is
504403158265495552. In what other platforms have you tested this? -
sorry, wrong typo.. desktop is 504403158265495552 and WCE Emulator result is 504403158265495550
The Pocket PC has no native FPU. This may be due to rounding errors (or just plain calculation errors) in in the FPU emulator library.