Clarification on Bonferroni in hypothesis testing
$begingroup$
Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
$$
H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
$$
where $perp$ denotes independence.
One way to do this is to test
$$
H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?
probability statistics random-variables hypothesis-testing
$endgroup$
add a comment |
$begingroup$
Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
$$
H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
$$
where $perp$ denotes independence.
One way to do this is to test
$$
H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?
probability statistics random-variables hypothesis-testing
$endgroup$
add a comment |
$begingroup$
Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
$$
H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
$$
where $perp$ denotes independence.
One way to do this is to test
$$
H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?
probability statistics random-variables hypothesis-testing
$endgroup$
Could you help me to clarify how to use Bonferroni correction in hypothesis testing? Suppose I want to test
$$
H_0: X perp Y text{ , } Z perp Y text{ , } X perp Z hspace{1cm} text{at level $alpha=5%$}
$$
where $perp$ denotes independence.
One way to do this is to test
$$
H_0^1: X perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^2: Z perp Y hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
$$
H_0^3: X perp Z hspace{1cm} text{at level $alpha=frac{5}{3}%$}
$$
What I am not sure about is the following: once I have the results of these three tests, what should I conclude about $H_0$? Should I reject $H_0$ if I reject at least one among $H_0^1, H_0^2, H_0^3$? Should I reject $H_0$ if I reject all of $H_0^1, H_0^2, H_0^3$?
probability statistics random-variables hypothesis-testing
probability statistics random-variables hypothesis-testing
edited May 10 '17 at 11:53
STF
asked May 10 '17 at 11:34
STFSTF
461422
461422
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
$begingroup$
The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.
The comma is often used as the replacement for AND
($wedge$ in logic).
Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
$$begin{array}{|c|c|c|}hline
p & q & pwedge q\
hline
T & T & T \ hline
T & F & F \ hline
F & T & F \hline
F & F & F \hline
end{array}.$$
The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain
$$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
hline T & T & T & T& T\
hline F & T & T & F &F \
hline F & F & T & F& F\
hline F & F & F & F&F \
hline T & F & F & F&F \
hline T & T & F & T&F \
hline F & T & F & F&F \
hline T & F & T & F&F \ hline
end{array}$$
Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).
$endgroup$
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
add a comment |
$begingroup$
Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.
For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2274621%2fclarification-on-bonferroni-in-hypothesis-testing%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.
The comma is often used as the replacement for AND
($wedge$ in logic).
Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
$$begin{array}{|c|c|c|}hline
p & q & pwedge q\
hline
T & T & T \ hline
T & F & F \ hline
F & T & F \hline
F & F & F \hline
end{array}.$$
The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain
$$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
hline T & T & T & T& T\
hline F & T & T & F &F \
hline F & F & T & F& F\
hline F & F & F & F&F \
hline T & F & F & F&F \
hline T & T & F & T&F \
hline F & T & F & F&F \
hline T & F & T & F&F \ hline
end{array}$$
Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).
$endgroup$
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
add a comment |
$begingroup$
The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.
The comma is often used as the replacement for AND
($wedge$ in logic).
Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
$$begin{array}{|c|c|c|}hline
p & q & pwedge q\
hline
T & T & T \ hline
T & F & F \ hline
F & T & F \hline
F & F & F \hline
end{array}.$$
The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain
$$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
hline T & T & T & T& T\
hline F & T & T & F &F \
hline F & F & T & F& F\
hline F & F & F & F&F \
hline T & F & F & F&F \
hline T & T & F & T&F \
hline F & T & F & F&F \
hline T & F & T & F&F \ hline
end{array}$$
Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).
$endgroup$
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
add a comment |
$begingroup$
The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.
The comma is often used as the replacement for AND
($wedge$ in logic).
Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
$$begin{array}{|c|c|c|}hline
p & q & pwedge q\
hline
T & T & T \ hline
T & F & F \ hline
F & T & F \hline
F & F & F \hline
end{array}.$$
The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain
$$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
hline T & T & T & T& T\
hline F & T & T & F &F \
hline F & F & T & F& F\
hline F & F & F & F&F \
hline T & F & F & F&F \
hline T & T & F & T&F \
hline F & T & F & F&F \
hline T & F & T & F&F \ hline
end{array}$$
Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).
$endgroup$
The solution here is quite simple, however I thought that I might be able to explain the logic in here in more formal way.
The comma is often used as the replacement for AND
($wedge$ in logic).
Let me write your problem in an equivalent form using truth tables. Recall that the truth table for logical conjunction is
$$begin{array}{|c|c|c|}hline
p & q & pwedge q\
hline
T & T & T \ hline
T & F & F \ hline
F & T & F \hline
F & F & F \hline
end{array}.$$
The hypothesis $H_0$ will hold if the last column of the below table returns the value true ($T$). We obtain
$$begin{array}{|c|c|c|c|c|}hline H_0^1 & H_0^1 & H_0^3 & H_0^1 wedge H_0^2 & (H_0^1 wedge H_0^2) wedge H_0^3 \
hline T & T & T & T& T\
hline F & T & T & F &F \
hline F & F & T & F& F\
hline F & F & F & F&F \
hline T & F & F & F&F \
hline T & T & F & T&F \
hline F & T & F & F&F \
hline T & F & T & F&F \ hline
end{array}$$
Therefore, you can see that $H_0$ holds only in one case. If your comma (AND) was replaced by OR, then you could translate this problem into logic tables and use the one for disjunction (OR).
edited May 10 '17 at 15:12
answered May 10 '17 at 14:59
m_gnacikm_gnacik
2,4381120
2,4381120
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
add a comment |
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Thanks. Hence, just to be sure about my final question: I reject $H_0$ if at least one among $H_0^1, H_0^2, H_0^3$ is false. Correct?
$endgroup$
– STF
May 10 '17 at 15:21
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
$begingroup$
Yes, indeed. You are right.
$endgroup$
– m_gnacik
May 10 '17 at 15:23
add a comment |
$begingroup$
Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.
For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.
$endgroup$
add a comment |
$begingroup$
Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.
For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.
$endgroup$
add a comment |
$begingroup$
Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.
For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.
$endgroup$
Usually there are more powerful ways to test a global hypothesis than the Bonferroni test. The advantage of using Bonferroni (and its variants) is that, not only can you reject the global hypotheses $H_0$ when there is at least one rejection among the tests at the $alpha/3$ level, you can also reject every individual component hypothesis $H_0^j$ that was rejected at that level.
For most tests of global hypotheses (e.g., the $F$ test), rejection of the global hypothesis $H_0$ does not allow you to make any statements about any of the component hypotheses $H_0^j$. More specifically, you can't say anything about the components following a global rejection if you wish you to control the Familywise Error Rate (FWER) over all components, when you use global tests such as the $F$ test. The benefit of the Bonferroni test of the global intersection hypothesis (unlike the $F$ global test), is that you can make statements about the components of the intersection, with complete FWER control.
answered Dec 14 '18 at 13:24
Peter WestfallPeter Westfall
1465
1465
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2274621%2fclarification-on-bonferroni-in-hypothesis-testing%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown