Python: Convert Edgelist from NetworkX into dataframe











up vote
1
down vote

favorite












I have a weird data structure (don't know if it's a list or tuple) as a results of using Networkx. I need to convert it into a dataframe.



The 'list' I have, has the following structure:



[('a', 'a', {'weight': 2}),
('a', '!', {'weight': 0}),
('a', 'c', {'weight': 2}),
('a', 'b', {'weight': 1}),
('a', 'q', {'weight': 1}),
('a', 's', {'weight': 2}),... ]


and I need a dataframe as follows:



Inf   Prov  Weight
a a 2
a ! 0
a c 2
a b 1
a q 1
a s 2


Can somebody give me hand, please?










share|improve this question


























    up vote
    1
    down vote

    favorite












    I have a weird data structure (don't know if it's a list or tuple) as a results of using Networkx. I need to convert it into a dataframe.



    The 'list' I have, has the following structure:



    [('a', 'a', {'weight': 2}),
    ('a', '!', {'weight': 0}),
    ('a', 'c', {'weight': 2}),
    ('a', 'b', {'weight': 1}),
    ('a', 'q', {'weight': 1}),
    ('a', 's', {'weight': 2}),... ]


    and I need a dataframe as follows:



    Inf   Prov  Weight
    a a 2
    a ! 0
    a c 2
    a b 1
    a q 1
    a s 2


    Can somebody give me hand, please?










    share|improve this question
























      up vote
      1
      down vote

      favorite









      up vote
      1
      down vote

      favorite











      I have a weird data structure (don't know if it's a list or tuple) as a results of using Networkx. I need to convert it into a dataframe.



      The 'list' I have, has the following structure:



      [('a', 'a', {'weight': 2}),
      ('a', '!', {'weight': 0}),
      ('a', 'c', {'weight': 2}),
      ('a', 'b', {'weight': 1}),
      ('a', 'q', {'weight': 1}),
      ('a', 's', {'weight': 2}),... ]


      and I need a dataframe as follows:



      Inf   Prov  Weight
      a a 2
      a ! 0
      a c 2
      a b 1
      a q 1
      a s 2


      Can somebody give me hand, please?










      share|improve this question













      I have a weird data structure (don't know if it's a list or tuple) as a results of using Networkx. I need to convert it into a dataframe.



      The 'list' I have, has the following structure:



      [('a', 'a', {'weight': 2}),
      ('a', '!', {'weight': 0}),
      ('a', 'c', {'weight': 2}),
      ('a', 'b', {'weight': 1}),
      ('a', 'q', {'weight': 1}),
      ('a', 's', {'weight': 2}),... ]


      and I need a dataframe as follows:



      Inf   Prov  Weight
      a a 2
      a ! 0
      a c 2
      a b 1
      a q 1
      a s 2


      Can somebody give me hand, please?







      python list dataframe tuples networkx






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 15 at 1:37









      PAstudilloE

      127111




      127111
























          2 Answers
          2






          active

          oldest

          votes

















          up vote
          1
          down vote













          It is probably easiest to simplify the data a bit first before creating the dataframe.
          Depending on the operation that gave you the initial data (a list of tuples, each one containing 2 strings and a dict), it may be possible to have that operation give you simplified data. But in the case that this is not possible -- or more generally, when you don't have control over data structures generated by a given library, you can do some simple manipulations, e.g. like this:



          import pandas as pd
          # initial data from qu
          raw_data = [('a', 'a', {'weight': 2}),
          ('a', '!', {'weight': 0}),
          ('a', 'c', {'weight': 2}),
          ('a', 'b', {'weight': 1}),
          ('a', 'q', {'weight': 1}),
          ('a', 's', {'weight': 2}),]

          # transform data to extract the value of each weight
          data = [(elem1, elem2, d_elem.get('weight', 0)) for (elem1, elem2, d_elem) in raw_data]

          # put together the dataframe from the list of records
          df = pd.DataFrame.from_records(data, columns=['Inf', 'Prov', 'Weight'])
          print(df)


          gives the result as desired:



            Inf Prov  Weight
          0 a a 2
          1 a ! 0
          2 a c 2
          3 a b 1
          4 a q 1
          5 a s 2


          using dict.get allows us to specify a default value if it is not defined, rather than raising a KeyError.






          share|improve this answer




























            up vote
            0
            down vote













            import pandas as pd
            x=[('a', 'a', {'weight': 2}),
            ('a', '!', {'weight': 0}),
            ('a', 'c', {'weight': 2}),
            ('a', 'b', {'weight': 1}),
            ('a', 'q', {'weight': 1}),
            ('a', 's', {'weight': 2})]

            inf_list=list()
            prov_list=list()
            weight_list=list()

            for tuple in x:
            inf_list.append(tuple[0])
            prov_list.append(tuple[1])
            weight_list.append(tuple[2])

            df=pd.DataFrame()
            df['inf']=inf_list
            df['prov']=prov_list
            df['weight']=weight_list

            df['weight']=df['weight'].map(lambda x:x['weight'])

            print(df)





            share|improve this answer





















              Your Answer






              StackExchange.ifUsing("editor", function () {
              StackExchange.using("externalEditor", function () {
              StackExchange.using("snippets", function () {
              StackExchange.snippets.init();
              });
              });
              }, "code-snippets");

              StackExchange.ready(function() {
              var channelOptions = {
              tags: "".split(" "),
              id: "1"
              };
              initTagRenderer("".split(" "), "".split(" "), channelOptions);

              StackExchange.using("externalEditor", function() {
              // Have to fire editor after snippets, if snippets enabled
              if (StackExchange.settings.snippets.snippetsEnabled) {
              StackExchange.using("snippets", function() {
              createEditor();
              });
              }
              else {
              createEditor();
              }
              });

              function createEditor() {
              StackExchange.prepareEditor({
              heartbeatType: 'answer',
              convertImagesToLinks: true,
              noModals: true,
              showLowRepImageUploadWarning: true,
              reputationToPostImages: 10,
              bindNavPrevention: true,
              postfix: "",
              imageUploader: {
              brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
              contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
              allowUrls: true
              },
              onDemand: true,
              discardSelector: ".discard-answer"
              ,immediatelyShowMarkdownHelp:true
              });


              }
              });














              draft saved

              draft discarded


















              StackExchange.ready(
              function () {
              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53311244%2fpython-convert-edgelist-from-networkx-into-dataframe%23new-answer', 'question_page');
              }
              );

              Post as a guest















              Required, but never shown

























              2 Answers
              2






              active

              oldest

              votes








              2 Answers
              2






              active

              oldest

              votes









              active

              oldest

              votes






              active

              oldest

              votes








              up vote
              1
              down vote













              It is probably easiest to simplify the data a bit first before creating the dataframe.
              Depending on the operation that gave you the initial data (a list of tuples, each one containing 2 strings and a dict), it may be possible to have that operation give you simplified data. But in the case that this is not possible -- or more generally, when you don't have control over data structures generated by a given library, you can do some simple manipulations, e.g. like this:



              import pandas as pd
              # initial data from qu
              raw_data = [('a', 'a', {'weight': 2}),
              ('a', '!', {'weight': 0}),
              ('a', 'c', {'weight': 2}),
              ('a', 'b', {'weight': 1}),
              ('a', 'q', {'weight': 1}),
              ('a', 's', {'weight': 2}),]

              # transform data to extract the value of each weight
              data = [(elem1, elem2, d_elem.get('weight', 0)) for (elem1, elem2, d_elem) in raw_data]

              # put together the dataframe from the list of records
              df = pd.DataFrame.from_records(data, columns=['Inf', 'Prov', 'Weight'])
              print(df)


              gives the result as desired:



                Inf Prov  Weight
              0 a a 2
              1 a ! 0
              2 a c 2
              3 a b 1
              4 a q 1
              5 a s 2


              using dict.get allows us to specify a default value if it is not defined, rather than raising a KeyError.






              share|improve this answer

























                up vote
                1
                down vote













                It is probably easiest to simplify the data a bit first before creating the dataframe.
                Depending on the operation that gave you the initial data (a list of tuples, each one containing 2 strings and a dict), it may be possible to have that operation give you simplified data. But in the case that this is not possible -- or more generally, when you don't have control over data structures generated by a given library, you can do some simple manipulations, e.g. like this:



                import pandas as pd
                # initial data from qu
                raw_data = [('a', 'a', {'weight': 2}),
                ('a', '!', {'weight': 0}),
                ('a', 'c', {'weight': 2}),
                ('a', 'b', {'weight': 1}),
                ('a', 'q', {'weight': 1}),
                ('a', 's', {'weight': 2}),]

                # transform data to extract the value of each weight
                data = [(elem1, elem2, d_elem.get('weight', 0)) for (elem1, elem2, d_elem) in raw_data]

                # put together the dataframe from the list of records
                df = pd.DataFrame.from_records(data, columns=['Inf', 'Prov', 'Weight'])
                print(df)


                gives the result as desired:



                  Inf Prov  Weight
                0 a a 2
                1 a ! 0
                2 a c 2
                3 a b 1
                4 a q 1
                5 a s 2


                using dict.get allows us to specify a default value if it is not defined, rather than raising a KeyError.






                share|improve this answer























                  up vote
                  1
                  down vote










                  up vote
                  1
                  down vote









                  It is probably easiest to simplify the data a bit first before creating the dataframe.
                  Depending on the operation that gave you the initial data (a list of tuples, each one containing 2 strings and a dict), it may be possible to have that operation give you simplified data. But in the case that this is not possible -- or more generally, when you don't have control over data structures generated by a given library, you can do some simple manipulations, e.g. like this:



                  import pandas as pd
                  # initial data from qu
                  raw_data = [('a', 'a', {'weight': 2}),
                  ('a', '!', {'weight': 0}),
                  ('a', 'c', {'weight': 2}),
                  ('a', 'b', {'weight': 1}),
                  ('a', 'q', {'weight': 1}),
                  ('a', 's', {'weight': 2}),]

                  # transform data to extract the value of each weight
                  data = [(elem1, elem2, d_elem.get('weight', 0)) for (elem1, elem2, d_elem) in raw_data]

                  # put together the dataframe from the list of records
                  df = pd.DataFrame.from_records(data, columns=['Inf', 'Prov', 'Weight'])
                  print(df)


                  gives the result as desired:



                    Inf Prov  Weight
                  0 a a 2
                  1 a ! 0
                  2 a c 2
                  3 a b 1
                  4 a q 1
                  5 a s 2


                  using dict.get allows us to specify a default value if it is not defined, rather than raising a KeyError.






                  share|improve this answer












                  It is probably easiest to simplify the data a bit first before creating the dataframe.
                  Depending on the operation that gave you the initial data (a list of tuples, each one containing 2 strings and a dict), it may be possible to have that operation give you simplified data. But in the case that this is not possible -- or more generally, when you don't have control over data structures generated by a given library, you can do some simple manipulations, e.g. like this:



                  import pandas as pd
                  # initial data from qu
                  raw_data = [('a', 'a', {'weight': 2}),
                  ('a', '!', {'weight': 0}),
                  ('a', 'c', {'weight': 2}),
                  ('a', 'b', {'weight': 1}),
                  ('a', 'q', {'weight': 1}),
                  ('a', 's', {'weight': 2}),]

                  # transform data to extract the value of each weight
                  data = [(elem1, elem2, d_elem.get('weight', 0)) for (elem1, elem2, d_elem) in raw_data]

                  # put together the dataframe from the list of records
                  df = pd.DataFrame.from_records(data, columns=['Inf', 'Prov', 'Weight'])
                  print(df)


                  gives the result as desired:



                    Inf Prov  Weight
                  0 a a 2
                  1 a ! 0
                  2 a c 2
                  3 a b 1
                  4 a q 1
                  5 a s 2


                  using dict.get allows us to specify a default value if it is not defined, rather than raising a KeyError.







                  share|improve this answer












                  share|improve this answer



                  share|improve this answer










                  answered Nov 15 at 11:19









                  Bonlenfum

                  11k13041




                  11k13041
























                      up vote
                      0
                      down vote













                      import pandas as pd
                      x=[('a', 'a', {'weight': 2}),
                      ('a', '!', {'weight': 0}),
                      ('a', 'c', {'weight': 2}),
                      ('a', 'b', {'weight': 1}),
                      ('a', 'q', {'weight': 1}),
                      ('a', 's', {'weight': 2})]

                      inf_list=list()
                      prov_list=list()
                      weight_list=list()

                      for tuple in x:
                      inf_list.append(tuple[0])
                      prov_list.append(tuple[1])
                      weight_list.append(tuple[2])

                      df=pd.DataFrame()
                      df['inf']=inf_list
                      df['prov']=prov_list
                      df['weight']=weight_list

                      df['weight']=df['weight'].map(lambda x:x['weight'])

                      print(df)





                      share|improve this answer

























                        up vote
                        0
                        down vote













                        import pandas as pd
                        x=[('a', 'a', {'weight': 2}),
                        ('a', '!', {'weight': 0}),
                        ('a', 'c', {'weight': 2}),
                        ('a', 'b', {'weight': 1}),
                        ('a', 'q', {'weight': 1}),
                        ('a', 's', {'weight': 2})]

                        inf_list=list()
                        prov_list=list()
                        weight_list=list()

                        for tuple in x:
                        inf_list.append(tuple[0])
                        prov_list.append(tuple[1])
                        weight_list.append(tuple[2])

                        df=pd.DataFrame()
                        df['inf']=inf_list
                        df['prov']=prov_list
                        df['weight']=weight_list

                        df['weight']=df['weight'].map(lambda x:x['weight'])

                        print(df)





                        share|improve this answer























                          up vote
                          0
                          down vote










                          up vote
                          0
                          down vote









                          import pandas as pd
                          x=[('a', 'a', {'weight': 2}),
                          ('a', '!', {'weight': 0}),
                          ('a', 'c', {'weight': 2}),
                          ('a', 'b', {'weight': 1}),
                          ('a', 'q', {'weight': 1}),
                          ('a', 's', {'weight': 2})]

                          inf_list=list()
                          prov_list=list()
                          weight_list=list()

                          for tuple in x:
                          inf_list.append(tuple[0])
                          prov_list.append(tuple[1])
                          weight_list.append(tuple[2])

                          df=pd.DataFrame()
                          df['inf']=inf_list
                          df['prov']=prov_list
                          df['weight']=weight_list

                          df['weight']=df['weight'].map(lambda x:x['weight'])

                          print(df)





                          share|improve this answer












                          import pandas as pd
                          x=[('a', 'a', {'weight': 2}),
                          ('a', '!', {'weight': 0}),
                          ('a', 'c', {'weight': 2}),
                          ('a', 'b', {'weight': 1}),
                          ('a', 'q', {'weight': 1}),
                          ('a', 's', {'weight': 2})]

                          inf_list=list()
                          prov_list=list()
                          weight_list=list()

                          for tuple in x:
                          inf_list.append(tuple[0])
                          prov_list.append(tuple[1])
                          weight_list.append(tuple[2])

                          df=pd.DataFrame()
                          df['inf']=inf_list
                          df['prov']=prov_list
                          df['weight']=weight_list

                          df['weight']=df['weight'].map(lambda x:x['weight'])

                          print(df)






                          share|improve this answer












                          share|improve this answer



                          share|improve this answer










                          answered Nov 29 at 21:03









                          Mohammad Hoseini

                          214




                          214






























                              draft saved

                              draft discarded




















































                              Thanks for contributing an answer to Stack Overflow!


                              • Please be sure to answer the question. Provide details and share your research!

                              But avoid



                              • Asking for help, clarification, or responding to other answers.

                              • Making statements based on opinion; back them up with references or personal experience.


                              To learn more, see our tips on writing great answers.





                              Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


                              Please pay close attention to the following guidance:


                              • Please be sure to answer the question. Provide details and share your research!

                              But avoid



                              • Asking for help, clarification, or responding to other answers.

                              • Making statements based on opinion; back them up with references or personal experience.


                              To learn more, see our tips on writing great answers.




                              draft saved


                              draft discarded














                              StackExchange.ready(
                              function () {
                              StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53311244%2fpython-convert-edgelist-from-networkx-into-dataframe%23new-answer', 'question_page');
                              }
                              );

                              Post as a guest















                              Required, but never shown





















































                              Required, but never shown














                              Required, but never shown












                              Required, but never shown







                              Required, but never shown

































                              Required, but never shown














                              Required, but never shown












                              Required, but never shown







                              Required, but never shown







                              Popular posts from this blog

                              Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

                              ComboBox Display Member on multiple fields

                              Is it possible to collect Nectar points via Trainline?