Memory Utilization R h2o

up vote
0
down vote

favorite

I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.

Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1.  Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero  ) - try decreasing ntrees and/or max_depth or increasing min_rows!

Here is my code sample:

 y<-"Survived"

x<-setdiff(names(newtrain_imp),y)

rf_mod<-h2o.randomForest(x,y,train_set,

                         nfolds = 10,

                         keep_cross_validation_predictions = T,

                         seed=233,

                         mtries = 8,#sampling default-1 set to al

                         ntrees = 500,

                         max_depth = 12,

                         validation_frame = validate_set,

                         binomial_double_trees = T)

asked Nov 14 at 6:03

NelsonGon

178111

During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 at 6:11

Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 at 6:15

Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 at 6:19

you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 at 6:20

There's no answer though.
– NelsonGon
Nov 14 at 6:22

add a comment |

up vote
0
down vote

favorite

I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.

Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1.  Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero  ) - try decreasing ntrees and/or max_depth or increasing min_rows!

Here is my code sample:

 y<-"Survived"

x<-setdiff(names(newtrain_imp),y)

rf_mod<-h2o.randomForest(x,y,train_set,

                         nfolds = 10,

                         keep_cross_validation_predictions = T,

                         seed=233,

                         mtries = 8,#sampling default-1 set to al

                         ntrees = 500,

                         max_depth = 12,

                         validation_frame = validate_set,

                         binomial_double_trees = T)

asked Nov 14 at 6:03

NelsonGon

178111

During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 at 6:11

Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 at 6:15

Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 at 6:19

you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 at 6:20

There's no answer though.
– NelsonGon
Nov 14 at 6:22

add a comment |

up vote
0
down vote

favorite

I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.

Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1.  Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero  ) - try decreasing ntrees and/or max_depth or increasing min_rows!

Here is my code sample:

 y<-"Survived"

x<-setdiff(names(newtrain_imp),y)

rf_mod<-h2o.randomForest(x,y,train_set,

                         nfolds = 10,

                         keep_cross_validation_predictions = T,

                         seed=233,

                         mtries = 8,#sampling default-1 set to al

                         ntrees = 500,

                         max_depth = 12,

                         validation_frame = validate_set,

                         binomial_double_trees = T)

asked Nov 14 at 6:03

NelsonGon

178111

I'm working on the Titanic. However I've run into a problem where the model no longer runs but instead throws back an error that seems to have something to do with memory allocation.

Error: water.exceptions.H2OModelBuilderIllegalArgumentException: Illegal argument(s) for DRF model: DRF_model_R_1542172359909_24373_cv_1.  Details: ERRR on field: _ntrees: The tree model will not fit in the driver node's memory (2.4 KB per tree x 500 > Zero  ) - try decreasing ntrees and/or max_depth or increasing min_rows!

Here is my code sample:

 y<-"Survived"

x<-setdiff(names(newtrain_imp),y)

rf_mod<-h2o.randomForest(x,y,train_set,

                         nfolds = 10,

                         keep_cross_validation_predictions = T,

                         seed=233,

                         mtries = 8,#sampling default-1 set to al

                         ntrees = 500,

                         max_depth = 12,

                         validation_frame = validate_set,

                         binomial_double_trees = T)

r h2o

asked Nov 14 at 6:03

NelsonGon

178111

asked Nov 14 at 6:03

NelsonGon

178111

asked Nov 14 at 6:03

NelsonGon

178111

asked Nov 14 at 6:03

NelsonGon

178111

asked Nov 14 at 6:03

NelsonGon

178111

During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 at 6:11

Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 at 6:15

Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 at 6:19

you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 at 6:20

There's no answer though.
– NelsonGon
Nov 14 at 6:22

add a comment |

During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 at 6:11

Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 at 6:15

Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 at 6:19

you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 at 6:20

There's no answer though.
– NelsonGon
Nov 14 at 6:22

During initiating h2o using h2o.init(max_mem_size = ) here set the amount of RAM you want h2o to utilize.
– Hunaidkhan
Nov 14 at 6:11

Also it will be good if you can provide reproducible example using dput()
– Hunaidkhan
Nov 14 at 6:15

Restarting the session solved it. I wonder how to close this question.
– NelsonGon
Nov 14 at 6:19

you can click on marked as answer to close it .
– Hunaidkhan
Nov 14 at 6:20

There's no answer though.
– NelsonGon
Nov 14 at 6:22

add a comment |

1 Answer
1

active

oldest

votes

up vote
2
down vote

accepted

During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.

answered Nov 14 at 6:25

Hunaidkhan

60712

add a comment |

Your Answer

StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});

}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53294034%2fmemory-utilization-r-h2o%23new-answer', 'question_page');
}
);

Post as a guest

Name

Required, but never shown

1 Answer
1

active

oldest

votes

1 Answer
1

active

oldest

votes

up vote
2
down vote

accepted

During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.

answered Nov 14 at 6:25

Hunaidkhan

60712

add a comment |

up vote
2
down vote

accepted

During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.

answered Nov 14 at 6:25

Hunaidkhan

60712

add a comment |

up vote
2
down vote

accepted

During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.

answered Nov 14 at 6:25

Hunaidkhan

60712

During initiating h2o using h2o.init(max_mem_size = 8G) here set the amount of RAM you want h2o to utilize.

answered Nov 14 at 6:25

Hunaidkhan

60712

answered Nov 14 at 6:25

Hunaidkhan

60712

answered Nov 14 at 6:25

Hunaidkhan

60712

answered Nov 14 at 6:25

Hunaidkhan

60712

add a comment |

draft saved

draft discarded

Thanks for contributing an answer to Stack Overflow!

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

Some of your past answers have not been well-received, and you're in danger of being blocked from answering.

Please pay close attention to the following guidance:

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Name

Required, but never shown

Name

Required, but never shown

This page is only for reference, If you need detailed information, please check here

搜尋此網誌

Cfrgtkky