Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. Other Discussions
  3. Clever Code
  4. I hate floating point operations

I hate floating point operations

Scheduled Pinned Locked Moved Clever Code
c++comquestion
63 Posts 24 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • K Offline
    K Offline
    KaRl
    wrote on last edited by
    #1

    <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


    Where do you expect us to go when the bombs fall?

    Fold with us! ¤ flickr

    P C P R C 14 Replies Last reply
    0
    • K KaRl

      <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


      Where do you expect us to go when the bombs fall?

      Fold with us! ¤ flickr

      P Offline
      P Offline
      PIEBALDconsult
      wrote on last edited by
      #2

      A) Never hate B) Don't expect them to do what they can't

      1 1 Reply Last reply
      0
      • K KaRl

        <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


        Where do you expect us to go when the bombs fall?

        Fold with us! ¤ flickr

        C Offline
        C Offline
        Chris Meech
        wrote on last edited by
        #3

        I tried using the CRT assert instead and the same results occur. What's really surprising is the loss of precision when dSecondValue is evaluated. The second ASSERT is evaluating a compare between 1.4000000000000004 and 1.3999999999999999. But meanwhile dValue holds 0.10000000000000001. You do realize though that the first assert while being true, isn't comparing 0.1 to 0.1? Also when the number is less than 1 but greater than zero, you have seventeen digits of precision, but as soon as the value goes greater than 1, you only have sixteen digits of precision, following the decimal. It's odd that the digit four appears at the very end, cause it should have been truncated, I'd expect. Whether it's the use of assert, any comparisons using floating points are going to be subject to the oddities of float conversions to binary representations. They are good thing to avoid, if you can. :)

        Chris Meech I am Canadian. [heard in a local bar] I agree with you that my argument is useless. [Red Stateler] Hey, I am part of a special bread, we are called smart people [Captain See Sharp] The zen of the soapbox is hard to attain...[Jörgen Sigvardsson] I wish I could remember what it was like to only have a short term memory.[David Kentley]

        K 1 Reply Last reply
        0
        • C Chris Meech

          I tried using the CRT assert instead and the same results occur. What's really surprising is the loss of precision when dSecondValue is evaluated. The second ASSERT is evaluating a compare between 1.4000000000000004 and 1.3999999999999999. But meanwhile dValue holds 0.10000000000000001. You do realize though that the first assert while being true, isn't comparing 0.1 to 0.1? Also when the number is less than 1 but greater than zero, you have seventeen digits of precision, but as soon as the value goes greater than 1, you only have sixteen digits of precision, following the decimal. It's odd that the digit four appears at the very end, cause it should have been truncated, I'd expect. Whether it's the use of assert, any comparisons using floating points are going to be subject to the oddities of float conversions to binary representations. They are good thing to avoid, if you can. :)

          Chris Meech I am Canadian. [heard in a local bar] I agree with you that my argument is useless. [Red Stateler] Hey, I am part of a special bread, we are called smart people [Captain See Sharp] The zen of the soapbox is hard to attain...[Jörgen Sigvardsson] I wish I could remember what it was like to only have a short term memory.[David Kentley]

          K Offline
          K Offline
          KaRl
          wrote on last edited by
          #4

          Chris Meech wrote:

          . You do realize though that the first assert while being true, isn't comparing 0.1 to 0.1?

          Yep. Funny, isn't it?

          Chris Meech wrote:

          They are good thing to avoid, if you can.

          Sometimes, you cannot choose what you do inherit :sigh: I would add, avoid atof. All the troubles come from it :mad:


          Where do you expect us to go when the bombs fall?

          Fold with us! ¤ flickr

          1 Reply Last reply
          0
          • K KaRl

            <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


            Where do you expect us to go when the bombs fall?

            Fold with us! ¤ flickr

            P Offline
            P Offline
            PJ Arends
            wrote on last edited by
            #5

            Never use == when comparing floating point numbers. Instead use subtraction and compare the result against a threshold value.

            double Threshold = 0.00000001;
            double dSecondValue = 1 + dValue + dValue + dValue + dValue;
            ASSERT(fabs(dSecondValue - 1.4) < Threshold);

            Last modified: 2mins after originally posted -- be sure to use the absolute value - negatives do not work.


            You may be right I may be crazy -- Billy Joel -- Within you lies the power for good, use it!!!

            1 Reply Last reply
            0
            • K KaRl

              <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


              Where do you expect us to go when the bombs fall?

              Fold with us! ¤ flickr

              R Offline
              R Offline
              Ravi Bhavnani
              wrote on last edited by
              #6

              Anyone who dares to equality-compare floating point values with literals probably doesn't have a understanding of basic computer architecture. :) /ravi

              K R 2 Replies Last reply
              0
              • K KaRl

                <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


                Where do you expect us to go when the bombs fall?

                Fold with us! ¤ flickr

                P Offline
                P Offline
                PIEBALDconsult
                wrote on last edited by
                #7

                Maybe there should be "rookie mistakes" forum in here.

                K 1 Reply Last reply
                0
                • R Ravi Bhavnani

                  Anyone who dares to equality-compare floating point values with literals probably doesn't have a understanding of basic computer architecture. :) /ravi

                  K Offline
                  K Offline
                  KaRl
                  wrote on last edited by
                  #8

                  I may have oversimplified. The case was more like the following: double dTime = 0.; double dT = atof(<some value read in a file>); double dFinal = atof(<some value read in a file>); do{ ... dTime += dT; ... while(dTime < dFinal); A loop was missing because of the 'epsilon' induced by atof.


                  Where do you expect us to go when the bombs fall?

                  Fold with us! ¤ flickr

                  T G 2 Replies Last reply
                  0
                  • P PIEBALDconsult

                    Maybe there should be "rookie mistakes" forum in here.

                    K Offline
                    K Offline
                    KaRl
                    wrote on last edited by
                    #9

                    With yours it makes then two of them.


                    Where do you expect us to go when the bombs fall?

                    Fold with us! ¤ flickr

                    P 1 Reply Last reply
                    0
                    • K KaRl

                      <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


                      Where do you expect us to go when the bombs fall?

                      Fold with us! ¤ flickr

                      C Offline
                      C Offline
                      Chris Maunder
                      wrote on last edited by
                      #10

                      I really do think the compiler should throw an error when you try to compare floating point values for equality.

                      cheers, Chris Maunder

                      CodeProject.com : C++ MVP

                      K 1 2 Replies Last reply
                      0
                      • K KaRl

                        With yours it makes then two of them.


                        Where do you expect us to go when the bombs fall?

                        Fold with us! ¤ flickr

                        P Offline
                        P Offline
                        PIEBALDconsult
                        wrote on last edited by
                        #11

                        At least three actually. Hmmmm... four... Incomplete, in no particular order, and without admitting to which ones I've committed. General: 1) Trying to swap two values without an intermediary 2) Not realizing the limitations of floating-point numbers 3) Various ways of introducing infinite loops 3a) Including infinite recursion 3a1) Especially with properties 4) Tests which either always pass or always fail In C languages: 1) Accidently using assignment in a test 2) Accidently falling-through in switches (not in C#) In SQL: 1) Not understanding implicit conversions 2) Naming tables, columns, etc. with reserved words, and not knowing about [] (if available)

                        1 Reply Last reply
                        0
                        • K KaRl

                          <Using MFC> double dValue = atof("0.1"); ASSERT(dValue == 0.1); double dSecondValue = (1 + dValue + dValue + dValue + dValue); ASSERT(dSecondValue == 1.4); // Crash


                          Where do you expect us to go when the bombs fall?

                          Fold with us! ¤ flickr

                          R Offline
                          R Offline
                          Rick York
                          wrote on last edited by
                          #12

                          In VS2003 the float.h header has the following definitions : #define DBL_EPSILON 2.2204460492503131e-016 /* smallest such that 1.0+DBL_EPSILON != 1.0 */ This is a very handy value to use when comparing floating point values. A tactic similar to this can be used : double value = ComputeValue(); double delta = fabs( value - expectedValue ); if( delta <= DBL_EPSILON ) TRACE( "values are considered to be equal\n" );

                          W 1 Reply Last reply
                          0
                          • R Rick York

                            In VS2003 the float.h header has the following definitions : #define DBL_EPSILON 2.2204460492503131e-016 /* smallest such that 1.0+DBL_EPSILON != 1.0 */ This is a very handy value to use when comparing floating point values. A tactic similar to this can be used : double value = ComputeValue(); double delta = fabs( value - expectedValue ); if( delta <= DBL_EPSILON ) TRACE( "values are considered to be equal\n" );

                            W Offline
                            W Offline
                            Warren Stevens
                            wrote on last edited by
                            #13

                            Rick York wrote:

                            if( delta <= DBL_EPSILON )

                            This is still not foolproof, as the floating point round-off errors can accumulate, depending on your calculations. If there is enough error in your calculations (try using log() or tan() near their "blow up" values, if you want really bad results, really quickly) then DBL_EPSILON will not be sufficient. Unfortunately (having seen this problem in action for many years) there is no one-line solution to this problem. The proper comparison will depend on your calculations, the input values, and what you are using your results for.

                            www.IconsReview.com <-- Huge list of stock icon collections (both free and commercial)

                            R 1 Reply Last reply
                            0
                            • W Warren Stevens

                              Rick York wrote:

                              if( delta <= DBL_EPSILON )

                              This is still not foolproof, as the floating point round-off errors can accumulate, depending on your calculations. If there is enough error in your calculations (try using log() or tan() near their "blow up" values, if you want really bad results, really quickly) then DBL_EPSILON will not be sufficient. Unfortunately (having seen this problem in action for many years) there is no one-line solution to this problem. The proper comparison will depend on your calculations, the input values, and what you are using your results for.

                              www.IconsReview.com <-- Huge list of stock icon collections (both free and commercial)

                              R Offline
                              R Offline
                              Rick York
                              wrote on last edited by
                              #14

                              Very true and that's why I said, "A tactic similar to this can be used." Personally I always compare to a "tolerance" value and that works well. The big issue is - what do you use for a tolerance value ? That varies according to the circumstances as you said.

                              W T K 3 Replies Last reply
                              0
                              • K KaRl

                                I may have oversimplified. The case was more like the following: double dTime = 0.; double dT = atof(<some value read in a file>); double dFinal = atof(<some value read in a file>); do{ ... dTime += dT; ... while(dTime < dFinal); A loop was missing because of the 'epsilon' induced by atof.


                                Where do you expect us to go when the bombs fall?

                                Fold with us! ¤ flickr

                                T Offline
                                T Offline
                                Tim Smith
                                wrote on last edited by
                                #15

                                Ravi's statement still holds. Floating point addition is bad, multiplication is good. What is 20.0 + 0.000000000000000000000000000001? 20 There isn't enough mantissa to hold all the digits. Then you add in the fact that floating point is basically base 2 while our math is base 10, floating point doesn't have much hope of representing numbers exactly. That is why banks used such things as scaled integers.

                                Tim Smith I'm going to patent thought. I have yet to see any prior art.

                                K 1 Reply Last reply
                                0
                                • R Rick York

                                  Very true and that's why I said, "A tactic similar to this can be used." Personally I always compare to a "tolerance" value and that works well. The big issue is - what do you use for a tolerance value ? That varies according to the circumstances as you said.

                                  W Offline
                                  W Offline
                                  Warren Stevens
                                  wrote on last edited by
                                  #16

                                  Rick York wrote:

                                  Very true and that's why I said, "A tactic similar to this can be used."

                                  Don't take any offense - I wasn't trying to be pedantic (or bust your chops on the subject) I just wanted any newbie readers to be clear that there isn't a one-liner fix to the problem; after all this is the subtle bugs board.

                                  Rick York wrote:

                                  The big issue is - what do you use for a tolerance value ?

                                  Yes! :sigh: the million dollar question...


                                  www.IconsReview.com[^] Huge list of stock icon collections (both free and commercial)

                                  1 Reply Last reply
                                  0
                                  • R Rick York

                                    Very true and that's why I said, "A tactic similar to this can be used." Personally I always compare to a "tolerance" value and that works well. The big issue is - what do you use for a tolerance value ? That varies according to the circumstances as you said.

                                    T Offline
                                    T Offline
                                    Tim Smith
                                    wrote on last edited by
                                    #17

                                    Do a google search for "compare two floating point values" and you can find an article that talks about comparing two floats using their bit pattern (a.k.a. *((int *)&value)

                                    Tim Smith I'm going to patent thought. I have yet to see any prior art.

                                    1 Reply Last reply
                                    0
                                    • R Rick York

                                      Very true and that's why I said, "A tactic similar to this can be used." Personally I always compare to a "tolerance" value and that works well. The big issue is - what do you use for a tolerance value ? That varies according to the circumstances as you said.

                                      K Offline
                                      K Offline
                                      KaRl
                                      wrote on last edited by
                                      #18

                                      Rick York wrote:

                                      what do you use for a tolerance value ?

                                      Something adapted to the context but the risk of a mistaken test result will ever exist.


                                      Where do you expect us to go when the bombs fall?

                                      Fold with us! ¤ flickr

                                      1 Reply Last reply
                                      0
                                      • T Tim Smith

                                        Ravi's statement still holds. Floating point addition is bad, multiplication is good. What is 20.0 + 0.000000000000000000000000000001? 20 There isn't enough mantissa to hold all the digits. Then you add in the fact that floating point is basically base 2 while our math is base 10, floating point doesn't have much hope of representing numbers exactly. That is why banks used such things as scaled integers.

                                        Tim Smith I'm going to patent thought. I have yet to see any prior art.

                                        K Offline
                                        K Offline
                                        KaRl
                                        wrote on last edited by
                                        #19

                                        Tim Smith wrote:

                                        Ravi's statement still holds. Floating point addition is bad, multiplication is good.

                                        Mine still holds too, beware atof. I believe you could get the same result without any addition or multiplication (whose I doubt it is good). Introduction of an epsilon by atof is not indicated in the documentation[^]. Some might be fooled.

                                        Tim Smith wrote:

                                        scaled integers

                                        Replacing a double by a structure of an integer and a floating point position?


                                        Where do you expect us to go when the bombs fall?

                                        Fold with us! ¤ flickr

                                        D T 2 Replies Last reply
                                        0
                                        • C Chris Maunder

                                          I really do think the compiler should throw an error when you try to compare floating point values for equality.

                                          cheers, Chris Maunder

                                          CodeProject.com : C++ MVP

                                          K Offline
                                          K Offline
                                          KaRl
                                          wrote on last edited by
                                          #20

                                          A warning may be sufficient, like the ';' after a 'if'. In my case, that would not have been enough. Guys who made that code didn't believe in warnings. When I reactivated the compiler option, over 1,400 warnings popped up at the first rebuild. Yeepee.


                                          Where do you expect us to go when the bombs fall?

                                          Fold with us! ¤ flickr

                                          L 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups