Clarification on Bonferroni in hypothesis testing












0












$begingroup$


Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
$$
H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
$$
where $perp$ denotes independence.



One way to do this is to test
$$
H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?










share|cite|improve this question











$endgroup$

















    0












    $begingroup$


    Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
    $$
    H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
    $$
    where $perp$ denotes independence.



    One way to do this is to test
    $$
    H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
    $$
    $$
    H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
    $$
    $$
    H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
    $$
    What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?










    share|cite|improve this question











    $endgroup$















      0












      0








      0


      1



      $begingroup$


      Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
      $$
      H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
      $$
      where $perp$ denotes independence.



      One way to do this is to test
      $$
      H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      $$
      H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      $$
      H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?










      share|cite|improve this question











      $endgroup$




      Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
      $$
      H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
      $$
      where $perp$ denotes independence.



      One way to do this is to test
      $$
      H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      $$
      H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      $$
      H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
      $$
      What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?







      probability statistics random-variables hypothesis-testing






      share|cite|improve this question















      share|cite|improve this question













      share|cite|improve this question




      share|cite|improve this question








      edited May 10 '17 at 11:53







      STF

















      asked May 10 '17 at 11:34









      STFSTF

      461422




      461422






















          2 Answers
          2






          active

          oldest

          votes


















          1












          $begingroup$

          The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.



          The comma is often used as the replacement for AND ($wedge$ in logic).
          Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
          $$begin{array}{|c|c|c|}hline
          p & q & pwedge q\
          hline
          T & T & T \ hline
          T & F & F \ hline
          F & T & F \hline
          F & F & F \hline
          end{array}.$$
          The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain



          $$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
          hline T & T & T & T& T\
          hline F & T & T & F &F \
          hline F & F & T & F& F\
          hline F & F & F & F&F \
          hline T & F & F & F&F \
          hline T & T & F & T&F \
          hline F & T & F & F&F \
          hline T & F & T & F&F \ hline
          end{array}$$
          Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).






          share|cite|improve this answer











          $endgroup$













          • $begingroup$
            Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
            $endgroup$
            – STF
            May 10 '17 at 15:21










          • $begingroup$
            Yes, indeed. You are right.
            $endgroup$
            – m_gnacik
            May 10 '17 at 15:23



















          0












          $begingroup$

          Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.



          For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.






          share|cite|improve this answer









          $endgroup$














            Your Answer





            StackExchange.ifUsing("editor", function () {
            return StackExchange.using("mathjaxEditing", function () {
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            });
            });
            }, "mathjax-editing");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "69"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            noCode: true, onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2274621%2fclarification-on-bonferroni-in-hypothesis-testing%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            2 Answers
            2






            active

            oldest

            votes








            2 Answers
            2






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            1












            $begingroup$

            The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.



            The comma is often used as the replacement for AND ($wedge$ in logic).
            Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
            $$begin{array}{|c|c|c|}hline
            p & q & pwedge q\
            hline
            T & T & T \ hline
            T & F & F \ hline
            F & T & F \hline
            F & F & F \hline
            end{array}.$$
            The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain



            $$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
            hline T & T & T & T& T\
            hline F & T & T & F &F \
            hline F & F & T & F& F\
            hline F & F & F & F&F \
            hline T & F & F & F&F \
            hline T & T & F & T&F \
            hline F & T & F & F&F \
            hline T & F & T & F&F \ hline
            end{array}$$
            Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).






            share|cite|improve this answer











            $endgroup$













            • $begingroup$
              Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
              $endgroup$
              – STF
              May 10 '17 at 15:21










            • $begingroup$
              Yes, indeed. You are right.
              $endgroup$
              – m_gnacik
              May 10 '17 at 15:23
















            1












            $begingroup$

            The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.



            The comma is often used as the replacement for AND ($wedge$ in logic).
            Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
            $$begin{array}{|c|c|c|}hline
            p & q & pwedge q\
            hline
            T & T & T \ hline
            T & F & F \ hline
            F & T & F \hline
            F & F & F \hline
            end{array}.$$
            The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain



            $$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
            hline T & T & T & T& T\
            hline F & T & T & F &F \
            hline F & F & T & F& F\
            hline F & F & F & F&F \
            hline T & F & F & F&F \
            hline T & T & F & T&F \
            hline F & T & F & F&F \
            hline T & F & T & F&F \ hline
            end{array}$$
            Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).






            share|cite|improve this answer











            $endgroup$













            • $begingroup$
              Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
              $endgroup$
              – STF
              May 10 '17 at 15:21










            • $begingroup$
              Yes, indeed. You are right.
              $endgroup$
              – m_gnacik
              May 10 '17 at 15:23














            1












            1








            1





            $begingroup$

            The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.



            The comma is often used as the replacement for AND ($wedge$ in logic).
            Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
            $$begin{array}{|c|c|c|}hline
            p & q & pwedge q\
            hline
            T & T & T \ hline
            T & F & F \ hline
            F & T & F \hline
            F & F & F \hline
            end{array}.$$
            The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain



            $$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
            hline T & T & T & T& T\
            hline F & T & T & F &F \
            hline F & F & T & F& F\
            hline F & F & F & F&F \
            hline T & F & F & F&F \
            hline T & T & F & T&F \
            hline F & T & F & F&F \
            hline T & F & T & F&F \ hline
            end{array}$$
            Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).






            share|cite|improve this answer











            $endgroup$



            The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.



            The comma is often used as the replacement for AND ($wedge$ in logic).
            Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
            $$begin{array}{|c|c|c|}hline
            p & q & pwedge q\
            hline
            T & T & T \ hline
            T & F & F \ hline
            F & T & F \hline
            F & F & F \hline
            end{array}.$$
            The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain



            $$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
            hline T & T & T & T& T\
            hline F & T & T & F &F \
            hline F & F & T & F& F\
            hline F & F & F & F&F \
            hline T & F & F & F&F \
            hline T & T & F & T&F \
            hline F & T & F & F&F \
            hline T & F & T & F&F \ hline
            end{array}$$
            Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited May 10 '17 at 15:12

























            answered May 10 '17 at 14:59









            m_gnacikm_gnacik

            2,4381120




            2,4381120












            • $begingroup$
              Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
              $endgroup$
              – STF
              May 10 '17 at 15:21










            • $begingroup$
              Yes, indeed. You are right.
              $endgroup$
              – m_gnacik
              May 10 '17 at 15:23


















            • $begingroup$
              Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
              $endgroup$
              – STF
              May 10 '17 at 15:21










            • $begingroup$
              Yes, indeed. You are right.
              $endgroup$
              – m_gnacik
              May 10 '17 at 15:23
















            $begingroup$
            Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
            $endgroup$
            – STF
            May 10 '17 at 15:21




            $begingroup$
            Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
            $endgroup$
            – STF
            May 10 '17 at 15:21












            $begingroup$
            Yes, indeed. You are right.
            $endgroup$
            – m_gnacik
            May 10 '17 at 15:23




            $begingroup$
            Yes, indeed. You are right.
            $endgroup$
            – m_gnacik
            May 10 '17 at 15:23











            0












            $begingroup$

            Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.



            For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.






            share|cite|improve this answer









            $endgroup$


















              0












              $begingroup$

              Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.



              For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.






              share|cite|improve this answer









              $endgroup$
















                0












                0








                0





                $begingroup$

                Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.



                For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.






                share|cite|improve this answer









                $endgroup$



                Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.



                For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.







                share|cite|improve this answer












                share|cite|improve this answer



                share|cite|improve this answer










                answered Dec 14 '18 at 13:24









                Peter WestfallPeter Westfall

                1465




                1465






























                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Mathematics Stack Exchange!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2274621%2fclarification-on-bonferroni-in-hypothesis-testing%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

                    ComboBox Display Member on multiple fields

                    Is it possible to collect Nectar points via Trainline?