What is the use of coefficient in in Regression
$begingroup$
What is the meaning of coefficient values in Machine Learning. After I print
model.print_summary()
It shows, coefficient values of for each column. But I really don't know what is the meaning of coef
in this?
coef exp(coef) se(coef) z p lower 0.95 upper 0.95
EXPERIENCE IN DAYS -0.0013 0.9987 0.0001 -22.8579 0.0000 -0.0015 -0.0012 ***
GENDER 0.4598 1.5838 0.0786 5.8536 0.0000 0.3059 0.6138 ***
GRADE -0.7267 0.4835 0.0444 -16.3717 0.0000 -0.8136 -0.6397 ***
STAFFING_TYPE -0.4950 0.6096 0.0413 -11.9870 0.0000 -0.5759 -0.4140 ***
Is Large coef value represents strong feature or weaker feature ?
What is the use What is the use of coefficient in in Regression?
Note: Here model represents linear regression.
linear-algebra regression machine-learning
$endgroup$
add a comment |
$begingroup$
What is the meaning of coefficient values in Machine Learning. After I print
model.print_summary()
It shows, coefficient values of for each column. But I really don't know what is the meaning of coef
in this?
coef exp(coef) se(coef) z p lower 0.95 upper 0.95
EXPERIENCE IN DAYS -0.0013 0.9987 0.0001 -22.8579 0.0000 -0.0015 -0.0012 ***
GENDER 0.4598 1.5838 0.0786 5.8536 0.0000 0.3059 0.6138 ***
GRADE -0.7267 0.4835 0.0444 -16.3717 0.0000 -0.8136 -0.6397 ***
STAFFING_TYPE -0.4950 0.6096 0.0413 -11.9870 0.0000 -0.5759 -0.4140 ***
Is Large coef value represents strong feature or weaker feature ?
What is the use What is the use of coefficient in in Regression?
Note: Here model represents linear regression.
linear-algebra regression machine-learning
$endgroup$
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23
add a comment |
$begingroup$
What is the meaning of coefficient values in Machine Learning. After I print
model.print_summary()
It shows, coefficient values of for each column. But I really don't know what is the meaning of coef
in this?
coef exp(coef) se(coef) z p lower 0.95 upper 0.95
EXPERIENCE IN DAYS -0.0013 0.9987 0.0001 -22.8579 0.0000 -0.0015 -0.0012 ***
GENDER 0.4598 1.5838 0.0786 5.8536 0.0000 0.3059 0.6138 ***
GRADE -0.7267 0.4835 0.0444 -16.3717 0.0000 -0.8136 -0.6397 ***
STAFFING_TYPE -0.4950 0.6096 0.0413 -11.9870 0.0000 -0.5759 -0.4140 ***
Is Large coef value represents strong feature or weaker feature ?
What is the use What is the use of coefficient in in Regression?
Note: Here model represents linear regression.
linear-algebra regression machine-learning
$endgroup$
What is the meaning of coefficient values in Machine Learning. After I print
model.print_summary()
It shows, coefficient values of for each column. But I really don't know what is the meaning of coef
in this?
coef exp(coef) se(coef) z p lower 0.95 upper 0.95
EXPERIENCE IN DAYS -0.0013 0.9987 0.0001 -22.8579 0.0000 -0.0015 -0.0012 ***
GENDER 0.4598 1.5838 0.0786 5.8536 0.0000 0.3059 0.6138 ***
GRADE -0.7267 0.4835 0.0444 -16.3717 0.0000 -0.8136 -0.6397 ***
STAFFING_TYPE -0.4950 0.6096 0.0413 -11.9870 0.0000 -0.5759 -0.4140 ***
Is Large coef value represents strong feature or weaker feature ?
What is the use What is the use of coefficient in in Regression?
Note: Here model represents linear regression.
linear-algebra regression machine-learning
linear-algebra regression machine-learning
edited Nov 27 '18 at 5:24
Mohamed Thasin ah
asked Nov 27 '18 at 4:40
Mohamed Thasin ahMohamed Thasin ah
1105
1105
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23
add a comment |
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
When you have a linear regression model with $n$ exogenic variables, the model is
$$
y = beta_0 + beta_1 x_1 + beta_2 x_2 + ldots + beta_n x_n + xi
$$
So you are looking for coefficients $beta_1$, $beta_2$, $ldots$, $beta_n$, so that the difference between the output ($y$) of your model for a given input vector $(x_1, dots, x_n)$ compared to your data is minimized.
In other words the coefficients determine how much a change of each input variable contributes to the output variable. For example, a coefficient of 0.4598 for your variable $x_2$ (Gender) means that the output variable $y$ increases for 0.4598 if the variable Gender increases for 1.
$endgroup$
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome ofy
right?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3015337%2fwhat-is-the-use-of-coefficient-in-in-regression%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
When you have a linear regression model with $n$ exogenic variables, the model is
$$
y = beta_0 + beta_1 x_1 + beta_2 x_2 + ldots + beta_n x_n + xi
$$
So you are looking for coefficients $beta_1$, $beta_2$, $ldots$, $beta_n$, so that the difference between the output ($y$) of your model for a given input vector $(x_1, dots, x_n)$ compared to your data is minimized.
In other words the coefficients determine how much a change of each input variable contributes to the output variable. For example, a coefficient of 0.4598 for your variable $x_2$ (Gender) means that the output variable $y$ increases for 0.4598 if the variable Gender increases for 1.
$endgroup$
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome ofy
right?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
add a comment |
$begingroup$
When you have a linear regression model with $n$ exogenic variables, the model is
$$
y = beta_0 + beta_1 x_1 + beta_2 x_2 + ldots + beta_n x_n + xi
$$
So you are looking for coefficients $beta_1$, $beta_2$, $ldots$, $beta_n$, so that the difference between the output ($y$) of your model for a given input vector $(x_1, dots, x_n)$ compared to your data is minimized.
In other words the coefficients determine how much a change of each input variable contributes to the output variable. For example, a coefficient of 0.4598 for your variable $x_2$ (Gender) means that the output variable $y$ increases for 0.4598 if the variable Gender increases for 1.
$endgroup$
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome ofy
right?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
add a comment |
$begingroup$
When you have a linear regression model with $n$ exogenic variables, the model is
$$
y = beta_0 + beta_1 x_1 + beta_2 x_2 + ldots + beta_n x_n + xi
$$
So you are looking for coefficients $beta_1$, $beta_2$, $ldots$, $beta_n$, so that the difference between the output ($y$) of your model for a given input vector $(x_1, dots, x_n)$ compared to your data is minimized.
In other words the coefficients determine how much a change of each input variable contributes to the output variable. For example, a coefficient of 0.4598 for your variable $x_2$ (Gender) means that the output variable $y$ increases for 0.4598 if the variable Gender increases for 1.
$endgroup$
When you have a linear regression model with $n$ exogenic variables, the model is
$$
y = beta_0 + beta_1 x_1 + beta_2 x_2 + ldots + beta_n x_n + xi
$$
So you are looking for coefficients $beta_1$, $beta_2$, $ldots$, $beta_n$, so that the difference between the output ($y$) of your model for a given input vector $(x_1, dots, x_n)$ compared to your data is minimized.
In other words the coefficients determine how much a change of each input variable contributes to the output variable. For example, a coefficient of 0.4598 for your variable $x_2$ (Gender) means that the output variable $y$ increases for 0.4598 if the variable Gender increases for 1.
edited Nov 27 '18 at 5:54
answered Nov 27 '18 at 5:36
WolfgangPWolfgangP
1625
1625
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome ofy
right?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
add a comment |
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome ofy
right?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Thanks for the answer, Can I consider GENDER is a strong feature among them?
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:41
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
Strong is not the correct word here. Read the coefficients like this: if GENDER increases for 1, the output variable increases for 0.4598. If EXPERIENCE IN DAYS increases for 1, the output variable decreases for -0.0013 (given that all other input variables stay the same), etc.
$endgroup$
– WolfgangP
Nov 27 '18 at 5:50
$begingroup$
So Coeff represents influence of outcome of
y
right?$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
$begingroup$
So Coeff represents influence of outcome of
y
right?$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:56
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3015337%2fwhat-is-the-use-of-coefficient-in-in-regression%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
It really depends on what "model" is. If this is a linear regression model, then [roughly] the coefficient of a feature represents how much the response variable changes if you increase that feature by one unit and hold all other features constant.
$endgroup$
– angryavian
Nov 27 '18 at 5:07
$begingroup$
@angryavian - Thanks for the comment, I forgot to mention that, It's a linear regression model.
$endgroup$
– Mohamed Thasin ah
Nov 27 '18 at 5:23