Pandas : Precision error when converting string to float











up vote
0
down vote

favorite












Using pandas to deal with timestamps, I am concatening two columns and then convert the result in floating. It appears that when I display the two columns I observe two different results. How can the conversion from string to float can affect the value? Thanks for your help.



Here is the content of the data.csv file



epoch_day,epoch_ns
1533081601,224423000


Here is my test program:



import pandas as pd
pd.options.display.float_format = '{:.10f}'.format
df_mid = pd.read_csv("data.csv")

df_mid['result_1']=df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".")
df_mid['result_2'] = df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".").astype(float)
print(df_mid)


The result is :



   epoch_day   epoch_ns              result_1              result_2
0 1533081601 224423000 1533081601.224423000 1533081601.2244229317


Thanks for your help



FX










share|improve this question


























    up vote
    0
    down vote

    favorite












    Using pandas to deal with timestamps, I am concatening two columns and then convert the result in floating. It appears that when I display the two columns I observe two different results. How can the conversion from string to float can affect the value? Thanks for your help.



    Here is the content of the data.csv file



    epoch_day,epoch_ns
    1533081601,224423000


    Here is my test program:



    import pandas as pd
    pd.options.display.float_format = '{:.10f}'.format
    df_mid = pd.read_csv("data.csv")

    df_mid['result_1']=df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".")
    df_mid['result_2'] = df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".").astype(float)
    print(df_mid)


    The result is :



       epoch_day   epoch_ns              result_1              result_2
    0 1533081601 224423000 1533081601.224423000 1533081601.2244229317


    Thanks for your help



    FX










    share|improve this question
























      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      Using pandas to deal with timestamps, I am concatening two columns and then convert the result in floating. It appears that when I display the two columns I observe two different results. How can the conversion from string to float can affect the value? Thanks for your help.



      Here is the content of the data.csv file



      epoch_day,epoch_ns
      1533081601,224423000


      Here is my test program:



      import pandas as pd
      pd.options.display.float_format = '{:.10f}'.format
      df_mid = pd.read_csv("data.csv")

      df_mid['result_1']=df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".")
      df_mid['result_2'] = df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".").astype(float)
      print(df_mid)


      The result is :



         epoch_day   epoch_ns              result_1              result_2
      0 1533081601 224423000 1533081601.224423000 1533081601.2244229317


      Thanks for your help



      FX










      share|improve this question













      Using pandas to deal with timestamps, I am concatening two columns and then convert the result in floating. It appears that when I display the two columns I observe two different results. How can the conversion from string to float can affect the value? Thanks for your help.



      Here is the content of the data.csv file



      epoch_day,epoch_ns
      1533081601,224423000


      Here is my test program:



      import pandas as pd
      pd.options.display.float_format = '{:.10f}'.format
      df_mid = pd.read_csv("data.csv")

      df_mid['result_1']=df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".")
      df_mid['result_2'] = df_mid['epoch_day'].astype(str).str.cat(df_mid['epoch_ns'].astype(str), sep =".").astype(float)
      print(df_mid)


      The result is :



         epoch_day   epoch_ns              result_1              result_2
      0 1533081601 224423000 1533081601.224423000 1533081601.2244229317


      Thanks for your help



      FX







      string pandas precision floating-accuracy






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 13 at 5:16









      fxtokyo

      12




      12
























          1 Answer
          1






          active

          oldest

          votes

















          up vote
          0
          down vote













          Floating-point numbers are represented in computer hardware as base 2 (binary) fractions. Most decimal fractions cannot be represented exactly as binary fractions.



          When you convert your string, python creates a float which is the closest binary fraction for your input.



          You can actually see to which decimal number this corresponds by running the following:



          from decimal import Decimal
          Decimal(1533081601.224423000)
          OUTPUT: Decimal('1533081601.224422931671142578125')


          You can see the Python documentation for more info https://docs.python.org/2/tutorial/floatingpoint.html






          share|improve this answer





















            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














             

            draft saved


            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53274258%2fpandas-precision-error-when-converting-string-to-float%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes








            up vote
            0
            down vote













            Floating-point numbers are represented in computer hardware as base 2 (binary) fractions. Most decimal fractions cannot be represented exactly as binary fractions.



            When you convert your string, python creates a float which is the closest binary fraction for your input.



            You can actually see to which decimal number this corresponds by running the following:



            from decimal import Decimal
            Decimal(1533081601.224423000)
            OUTPUT: Decimal('1533081601.224422931671142578125')


            You can see the Python documentation for more info https://docs.python.org/2/tutorial/floatingpoint.html






            share|improve this answer

























              up vote
              0
              down vote













              Floating-point numbers are represented in computer hardware as base 2 (binary) fractions. Most decimal fractions cannot be represented exactly as binary fractions.



              When you convert your string, python creates a float which is the closest binary fraction for your input.



              You can actually see to which decimal number this corresponds by running the following:



              from decimal import Decimal
              Decimal(1533081601.224423000)
              OUTPUT: Decimal('1533081601.224422931671142578125')


              You can see the Python documentation for more info https://docs.python.org/2/tutorial/floatingpoint.html






              share|improve this answer























                up vote
                0
                down vote










                up vote
                0
                down vote









                Floating-point numbers are represented in computer hardware as base 2 (binary) fractions. Most decimal fractions cannot be represented exactly as binary fractions.



                When you convert your string, python creates a float which is the closest binary fraction for your input.



                You can actually see to which decimal number this corresponds by running the following:



                from decimal import Decimal
                Decimal(1533081601.224423000)
                OUTPUT: Decimal('1533081601.224422931671142578125')


                You can see the Python documentation for more info https://docs.python.org/2/tutorial/floatingpoint.html






                share|improve this answer












                Floating-point numbers are represented in computer hardware as base 2 (binary) fractions. Most decimal fractions cannot be represented exactly as binary fractions.



                When you convert your string, python creates a float which is the closest binary fraction for your input.



                You can actually see to which decimal number this corresponds by running the following:



                from decimal import Decimal
                Decimal(1533081601.224423000)
                OUTPUT: Decimal('1533081601.224422931671142578125')


                You can see the Python documentation for more info https://docs.python.org/2/tutorial/floatingpoint.html







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 20 at 17:40









                Guilherme Costa

                314




                314






























                     

                    draft saved


                    draft discarded



















































                     


                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53274258%2fpandas-precision-error-when-converting-string-to-float%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

                    ComboBox Display Member on multiple fields

                    Is it possible to collect Nectar points via Trainline?