Keep row and next one based on conditions - Pandas











up vote
0
down vote

favorite












I need to clean a dataset that is similar to the following:



https://i.stack.imgur.com/yMjuy.png



The expected result looks like this:



https://i.stack.imgur.com/QFJHS.png



In other words, I need to keep all rows that (1) have 'action' in the column 'ACTION' and the immediate next one - (2) if the next one has 'result' in that column.
I've tried several combination of .shift(), but it did not work.



Thanks in advance.










share|improve this question




























    up vote
    0
    down vote

    favorite












    I need to clean a dataset that is similar to the following:



    https://i.stack.imgur.com/yMjuy.png



    The expected result looks like this:



    https://i.stack.imgur.com/QFJHS.png



    In other words, I need to keep all rows that (1) have 'action' in the column 'ACTION' and the immediate next one - (2) if the next one has 'result' in that column.
    I've tried several combination of .shift(), but it did not work.



    Thanks in advance.










    share|improve this question


























      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      I need to clean a dataset that is similar to the following:



      https://i.stack.imgur.com/yMjuy.png



      The expected result looks like this:



      https://i.stack.imgur.com/QFJHS.png



      In other words, I need to keep all rows that (1) have 'action' in the column 'ACTION' and the immediate next one - (2) if the next one has 'result' in that column.
      I've tried several combination of .shift(), but it did not work.



      Thanks in advance.










      share|improve this question















      I need to clean a dataset that is similar to the following:



      https://i.stack.imgur.com/yMjuy.png



      The expected result looks like this:



      https://i.stack.imgur.com/QFJHS.png



      In other words, I need to keep all rows that (1) have 'action' in the column 'ACTION' and the immediate next one - (2) if the next one has 'result' in that column.
      I've tried several combination of .shift(), but it did not work.



      Thanks in advance.







      pandas






      share|improve this question















      share|improve this question













      share|improve this question




      share|improve this question








      edited Nov 14 at 9:19

























      asked Nov 13 at 17:32









      E. Faslo

      113




      113
























          1 Answer
          1






          active

          oldest

          votes

















          up vote
          0
          down vote













          You could try something like this:



          df.assign(step=df['Action'].eq('action').cumsum())
          .drop_duplicates(subset=['Action','step'], keep='first')
          .groupby('step')
          .filter(lambda x: x.step.count()==2)


          Output:



              SESSION  Action  TIME  step
          0 1 action 0.1 1
          1 1 result 0.2 1
          2 2 action 0.1 2
          3 2 result 0.2 2
          4 3 action 0.3 3
          5 3 result 0.4 3
          7 1 action 0.3 4
          8 1 result 0.4 4
          12 3 action 0.6 6
          13 3 result 0.7 6
          14 4 action 0.8 7
          15 4 result 0.9 7





          share|improve this answer





















            Your Answer






            StackExchange.ifUsing("editor", function () {
            StackExchange.using("externalEditor", function () {
            StackExchange.using("snippets", function () {
            StackExchange.snippets.init();
            });
            });
            }, "code-snippets");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "1"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53286589%2fkeep-row-and-next-one-based-on-conditions-pandas%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes








            up vote
            0
            down vote













            You could try something like this:



            df.assign(step=df['Action'].eq('action').cumsum())
            .drop_duplicates(subset=['Action','step'], keep='first')
            .groupby('step')
            .filter(lambda x: x.step.count()==2)


            Output:



                SESSION  Action  TIME  step
            0 1 action 0.1 1
            1 1 result 0.2 1
            2 2 action 0.1 2
            3 2 result 0.2 2
            4 3 action 0.3 3
            5 3 result 0.4 3
            7 1 action 0.3 4
            8 1 result 0.4 4
            12 3 action 0.6 6
            13 3 result 0.7 6
            14 4 action 0.8 7
            15 4 result 0.9 7





            share|improve this answer

























              up vote
              0
              down vote













              You could try something like this:



              df.assign(step=df['Action'].eq('action').cumsum())
              .drop_duplicates(subset=['Action','step'], keep='first')
              .groupby('step')
              .filter(lambda x: x.step.count()==2)


              Output:



                  SESSION  Action  TIME  step
              0 1 action 0.1 1
              1 1 result 0.2 1
              2 2 action 0.1 2
              3 2 result 0.2 2
              4 3 action 0.3 3
              5 3 result 0.4 3
              7 1 action 0.3 4
              8 1 result 0.4 4
              12 3 action 0.6 6
              13 3 result 0.7 6
              14 4 action 0.8 7
              15 4 result 0.9 7





              share|improve this answer























                up vote
                0
                down vote










                up vote
                0
                down vote









                You could try something like this:



                df.assign(step=df['Action'].eq('action').cumsum())
                .drop_duplicates(subset=['Action','step'], keep='first')
                .groupby('step')
                .filter(lambda x: x.step.count()==2)


                Output:



                    SESSION  Action  TIME  step
                0 1 action 0.1 1
                1 1 result 0.2 1
                2 2 action 0.1 2
                3 2 result 0.2 2
                4 3 action 0.3 3
                5 3 result 0.4 3
                7 1 action 0.3 4
                8 1 result 0.4 4
                12 3 action 0.6 6
                13 3 result 0.7 6
                14 4 action 0.8 7
                15 4 result 0.9 7





                share|improve this answer












                You could try something like this:



                df.assign(step=df['Action'].eq('action').cumsum())
                .drop_duplicates(subset=['Action','step'], keep='first')
                .groupby('step')
                .filter(lambda x: x.step.count()==2)


                Output:



                    SESSION  Action  TIME  step
                0 1 action 0.1 1
                1 1 result 0.2 1
                2 2 action 0.1 2
                3 2 result 0.2 2
                4 3 action 0.3 3
                5 3 result 0.4 3
                7 1 action 0.3 4
                8 1 result 0.4 4
                12 3 action 0.6 6
                13 3 result 0.7 6
                14 4 action 0.8 7
                15 4 result 0.9 7






                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered Nov 13 at 17:53









                Scott Boston

                49.3k72652




                49.3k72652






























                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Stack Overflow!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.





                    Some of your past answers have not been well-received, and you're in danger of being blocked from answering.


                    Please pay close attention to the following guidance:


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53286589%2fkeep-row-and-next-one-based-on-conditions-pandas%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    How to change which sound is reproduced for terminal bell?

                    Can I use Tabulator js library in my java Spring + Thymeleaf project?

                    Title Spacing in Bjornstrup Chapter, Removing Chapter Number From Contents