How do I train the Convolutional Neural Network with negative and positive elements as the input of the first...












0















Just I am curious why I have to scale the testing set on the testing set, and not on the training set when I’m training a model on, for example, CNN?!
Or am I wrong? And I still have to scale it on the training set.
Also, can I train a dataset in the CNN that contents positive and negative elements as the first input of the network?
Any answers with reference will be really appreciated.






python tensorflow conv-neural-network







share|improve this question

























  • you scale both train and test data

    – Mitch Wheat
    Nov 21 '18 at 3:06











  • I know that. My question is why should I scale the testing data on the testing data instead of the training data?

    – Protocol313
    Nov 21 '18 at 3:12


















0















Just I am curious why I have to scale the testing set on the testing set, and not on the training set when I’m training a model on, for example, CNN?!
Or am I wrong? And I still have to scale it on the training set.
Also, can I train a dataset in the CNN that contents positive and negative elements as the first input of the network?
Any answers with reference will be really appreciated.






python tensorflow conv-neural-network







share|improve this question

























  • you scale both train and test data

    – Mitch Wheat
    Nov 21 '18 at 3:06











  • I know that. My question is why should I scale the testing data on the testing data instead of the training data?

    – Protocol313
    Nov 21 '18 at 3:12
















0












0








0


2






Just I am curious why I have to scale the testing set on the testing set, and not on the training set when I’m training a model on, for example, CNN?!
Or am I wrong? And I still have to scale it on the training set.
Also, can I train a dataset in the CNN that contents positive and negative elements as the first input of the network?
Any answers with reference will be really appreciated.






python tensorflow conv-neural-network







share|improve this question
















Just I am curious why I have to scale the testing set on the testing set, and not on the training set when I’m training a model on, for example, CNN?!
Or am I wrong? And I still have to scale it on the training set.
Also, can I train a dataset in the CNN that contents positive and negative elements as the first input of the network?
Any answers with reference will be really appreciated.






python tensorflow conv-neural-network




python tensorflow conv-neural-network






share|improve this question















share|improve this question













share|improve this question




share|improve this question








edited Nov 21 '18 at 3:15







Protocol313

















asked Nov 21 '18 at 3:00









Protocol313Protocol313

44




44













  • you scale both train and test data

    – Mitch Wheat
    Nov 21 '18 at 3:06











  • I know that. My question is why should I scale the testing data on the testing data instead of the training data?

    – Protocol313
    Nov 21 '18 at 3:12





















  • you scale both train and test data

    – Mitch Wheat
    Nov 21 '18 at 3:06











  • I know that. My question is why should I scale the testing data on the testing data instead of the training data?

    – Protocol313
    Nov 21 '18 at 3:12



















you scale both train and test data

– Mitch Wheat
Nov 21 '18 at 3:06





you scale both train and test data

– Mitch Wheat
Nov 21 '18 at 3:06













I know that. My question is why should I scale the testing data on the testing data instead of the training data?

– Protocol313
Nov 21 '18 at 3:12







I know that. My question is why should I scale the testing data on the testing data instead of the training data?

– Protocol313
Nov 21 '18 at 3:12














3 Answers
3






active

oldest

votes


















0














Only because I cannot comment (reputation barrier), I am writing it here as an answer. Scaling data depends upon the requirement as well the feed/data you got. Test data gets scaled with Test data only, because Test data don't have the Target variable (one less feature in Test data). If we scale our Training data with new Test data, our model will not be able to correlate with any target variable and thus fail to learn. So the key difference is the existence of Target variable.






share|improve this answer
























  • Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

    – Protocol313
    Nov 21 '18 at 3:37













  • Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

    – Random Nerd
    Nov 21 '18 at 4:27



















0














We usually have 3 types of datasets for getting a model trained,




  1. Training Dataset

  2. Validation Dataset

  3. Test Dataset


Training Dataset



This should be an evenly distributed data set which covers all varieties of data. If your train with more epochs, the model will get used to the training dataset and will only give proper proper prediction on the training dataset and this is called Overfitting. Only way to keep a check on overfitting is by having other datasets which the model has never been trained on.



Validation Dataset



This can be used fine tune model hyperparameters



Test Dataset



This is the dataset which the model has not been trained on has never been a part of deciding the hyperparameters and will give the reality of how the model is performing.






share|improve this answer































    0














    If scaling and normalization is used, the testing set should use the same parameters used during training.
    A good answer that links to that: https://datascience.stackexchange.com/questions/27615/should-we-apply-normalization-to-test-data-as-well



    Also, some models tend to require normalization and others do not.
    The Neural Network architectures are normally robust and might not need normalization.






    share|improve this answer























      Your Answer






      StackExchange.ifUsing("editor", function () {
      StackExchange.using("externalEditor", function () {
      StackExchange.using("snippets", function () {
      StackExchange.snippets.init();
      });
      });
      }, "code-snippets");

      StackExchange.ready(function() {
      var channelOptions = {
      tags: "".split(" "),
      id: "1"
      };
      initTagRenderer("".split(" "), "".split(" "), channelOptions);

      StackExchange.using("externalEditor", function() {
      // Have to fire editor after snippets, if snippets enabled
      if (StackExchange.settings.snippets.snippetsEnabled) {
      StackExchange.using("snippets", function() {
      createEditor();
      });
      }
      else {
      createEditor();
      }
      });

      function createEditor() {
      StackExchange.prepareEditor({
      heartbeatType: 'answer',
      autoActivateHeartbeat: false,
      convertImagesToLinks: true,
      noModals: true,
      showLowRepImageUploadWarning: true,
      reputationToPostImages: 10,
      bindNavPrevention: true,
      postfix: "",
      imageUploader: {
      brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
      contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
      allowUrls: true
      },
      onDemand: true,
      discardSelector: ".discard-answer"
      ,immediatelyShowMarkdownHelp:true
      });


      }
      });














      draft saved

      draft discarded


















      StackExchange.ready(
      function () {
      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53404679%2fhow-do-i-train-the-convolutional-neural-network-with-negative-and-positive-eleme%23new-answer', 'question_page');
      }
      );

      Post as a guest















      Required, but never shown

























      3 Answers
      3






      active

      oldest

      votes








      3 Answers
      3






      active

      oldest

      votes









      active

      oldest

      votes






      active

      oldest

      votes









      0














      Only because I cannot comment (reputation barrier), I am writing it here as an answer. Scaling data depends upon the requirement as well the feed/data you got. Test data gets scaled with Test data only, because Test data don't have the Target variable (one less feature in Test data). If we scale our Training data with new Test data, our model will not be able to correlate with any target variable and thus fail to learn. So the key difference is the existence of Target variable.






      share|improve this answer
























      • Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

        – Protocol313
        Nov 21 '18 at 3:37













      • Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

        – Random Nerd
        Nov 21 '18 at 4:27
















      0














      Only because I cannot comment (reputation barrier), I am writing it here as an answer. Scaling data depends upon the requirement as well the feed/data you got. Test data gets scaled with Test data only, because Test data don't have the Target variable (one less feature in Test data). If we scale our Training data with new Test data, our model will not be able to correlate with any target variable and thus fail to learn. So the key difference is the existence of Target variable.






      share|improve this answer
























      • Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

        – Protocol313
        Nov 21 '18 at 3:37













      • Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

        – Random Nerd
        Nov 21 '18 at 4:27














      0












      0








      0







      Only because I cannot comment (reputation barrier), I am writing it here as an answer. Scaling data depends upon the requirement as well the feed/data you got. Test data gets scaled with Test data only, because Test data don't have the Target variable (one less feature in Test data). If we scale our Training data with new Test data, our model will not be able to correlate with any target variable and thus fail to learn. So the key difference is the existence of Target variable.






      share|improve this answer













      Only because I cannot comment (reputation barrier), I am writing it here as an answer. Scaling data depends upon the requirement as well the feed/data you got. Test data gets scaled with Test data only, because Test data don't have the Target variable (one less feature in Test data). If we scale our Training data with new Test data, our model will not be able to correlate with any target variable and thus fail to learn. So the key difference is the existence of Target variable.







      share|improve this answer












      share|improve this answer



      share|improve this answer










      answered Nov 21 '18 at 3:23









      Random NerdRandom Nerd

      1314




      1314













      • Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

        – Protocol313
        Nov 21 '18 at 3:37













      • Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

        – Random Nerd
        Nov 21 '18 at 4:27



















      • Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

        – Protocol313
        Nov 21 '18 at 3:37













      • Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

        – Random Nerd
        Nov 21 '18 at 4:27

















      Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

      – Protocol313
      Nov 21 '18 at 3:37







      Thanks for your answer. I knew the basic concepts of the answer, but I have not found any references yet. Do you have any reference for the answer? Please. Also, do you have an answer to the second one? Thanks

      – Protocol313
      Nov 21 '18 at 3:37















      Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

      – Random Nerd
      Nov 21 '18 at 4:27





      Few worthy references that I could find are Article1, Article2 and Article3 (kindly google for retraining ML models for more references). For second one, kindly detail your question with more info on what you mean by positive/negative elements (that too being passed in a CNN?)

      – Random Nerd
      Nov 21 '18 at 4:27













      0














      We usually have 3 types of datasets for getting a model trained,




      1. Training Dataset

      2. Validation Dataset

      3. Test Dataset


      Training Dataset



      This should be an evenly distributed data set which covers all varieties of data. If your train with more epochs, the model will get used to the training dataset and will only give proper proper prediction on the training dataset and this is called Overfitting. Only way to keep a check on overfitting is by having other datasets which the model has never been trained on.



      Validation Dataset



      This can be used fine tune model hyperparameters



      Test Dataset



      This is the dataset which the model has not been trained on has never been a part of deciding the hyperparameters and will give the reality of how the model is performing.






      share|improve this answer




























        0














        We usually have 3 types of datasets for getting a model trained,




        1. Training Dataset

        2. Validation Dataset

        3. Test Dataset


        Training Dataset



        This should be an evenly distributed data set which covers all varieties of data. If your train with more epochs, the model will get used to the training dataset and will only give proper proper prediction on the training dataset and this is called Overfitting. Only way to keep a check on overfitting is by having other datasets which the model has never been trained on.



        Validation Dataset



        This can be used fine tune model hyperparameters



        Test Dataset



        This is the dataset which the model has not been trained on has never been a part of deciding the hyperparameters and will give the reality of how the model is performing.






        share|improve this answer


























          0












          0








          0







          We usually have 3 types of datasets for getting a model trained,




          1. Training Dataset

          2. Validation Dataset

          3. Test Dataset


          Training Dataset



          This should be an evenly distributed data set which covers all varieties of data. If your train with more epochs, the model will get used to the training dataset and will only give proper proper prediction on the training dataset and this is called Overfitting. Only way to keep a check on overfitting is by having other datasets which the model has never been trained on.



          Validation Dataset



          This can be used fine tune model hyperparameters



          Test Dataset



          This is the dataset which the model has not been trained on has never been a part of deciding the hyperparameters and will give the reality of how the model is performing.






          share|improve this answer













          We usually have 3 types of datasets for getting a model trained,




          1. Training Dataset

          2. Validation Dataset

          3. Test Dataset


          Training Dataset



          This should be an evenly distributed data set which covers all varieties of data. If your train with more epochs, the model will get used to the training dataset and will only give proper proper prediction on the training dataset and this is called Overfitting. Only way to keep a check on overfitting is by having other datasets which the model has never been trained on.



          Validation Dataset



          This can be used fine tune model hyperparameters



          Test Dataset



          This is the dataset which the model has not been trained on has never been a part of deciding the hyperparameters and will give the reality of how the model is performing.







          share|improve this answer












          share|improve this answer



          share|improve this answer










          answered Nov 21 '18 at 3:46









          JeevanJeevan

          1326




          1326























              0














              If scaling and normalization is used, the testing set should use the same parameters used during training.
              A good answer that links to that: https://datascience.stackexchange.com/questions/27615/should-we-apply-normalization-to-test-data-as-well



              Also, some models tend to require normalization and others do not.
              The Neural Network architectures are normally robust and might not need normalization.






              share|improve this answer




























                0














                If scaling and normalization is used, the testing set should use the same parameters used during training.
                A good answer that links to that: https://datascience.stackexchange.com/questions/27615/should-we-apply-normalization-to-test-data-as-well



                Also, some models tend to require normalization and others do not.
                The Neural Network architectures are normally robust and might not need normalization.






                share|improve this answer


























                  0












                  0








                  0







                  If scaling and normalization is used, the testing set should use the same parameters used during training.
                  A good answer that links to that: https://datascience.stackexchange.com/questions/27615/should-we-apply-normalization-to-test-data-as-well



                  Also, some models tend to require normalization and others do not.
                  The Neural Network architectures are normally robust and might not need normalization.






                  share|improve this answer













                  If scaling and normalization is used, the testing set should use the same parameters used during training.
                  A good answer that links to that: https://datascience.stackexchange.com/questions/27615/should-we-apply-normalization-to-test-data-as-well



                  Also, some models tend to require normalization and others do not.
                  The Neural Network architectures are normally robust and might not need normalization.







                  share|improve this answer












                  share|improve this answer



                  share|improve this answer










                  answered Nov 21 '18 at 12:38









                  Pedro TorresPedro Torres

                  703413




                  703413






























                      draft saved

                      draft discarded




















































                      Thanks for contributing an answer to Stack Overflow!


                      • Please be sure to answer the question. Provide details and share your research!

                      But avoid …



                      • Asking for help, clarification, or responding to other answers.

                      • Making statements based on opinion; back them up with references or personal experience.


                      To learn more, see our tips on writing great answers.




                      draft saved


                      draft discarded














                      StackExchange.ready(
                      function () {
                      StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53404679%2fhow-do-i-train-the-convolutional-neural-network-with-negative-and-positive-eleme%23new-answer', 'question_page');
                      }
                      );

                      Post as a guest















                      Required, but never shown





















































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown

































                      Required, but never shown














                      Required, but never shown












                      Required, but never shown







                      Required, but never shown







                      -

                      Popular posts from this blog

                      Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

                      Image
                      2 2 I have a Zotero bibliography in Overleaf. I use biblatex . usepackage[backend=biber,citestyle=authoryear]{biblatex} addbibresource{zoteroALH.bib} Bibliography entries look like: @book{de_saint-gervais_uniformization_2016, title = {Uniformization of {Riemann} {Surfaces}}, isbn = {978-3-03719-145-3}, url = {https://www.ems-ph.org/books/book.php?proj_nr=198&srch=series%7Chem}, urldate = {2019-02-03}, author = {de Saint-Gervais, Paul Henri}, year = {2016}, doi = {10.4171/145} } In the bibliography down the paper the reference shows like this: There is the DOI, great, but also the URL which is unnecessary when the DOI is there. How can I remove the URL when the DOI is present? biblatex bibliographies overleaf zote
                      Read more

                      ComboBox Display Member on multiple fields

                      Image
                      2 I'm trying to set the .DisplayMember property of a ComboBox in C#, but I want to bind it to multiple columns in the .DataSouce . My SQL looks like this: SELECT PersNbr, PersFirstName, PersMiddleName, PersLastName FROM Pers WHERE PersNbr = :persNbr; I'm saving this query in a DataTable so each column selected has it's own column in the Datatable . I want to make the .DisplayMember a combination of PersFirstName + PersMiddleName + PersLastName so their full name appears like this: comboBox.DisplayMemeber = "PersFirstName" + "PersMiddleName" + "PersLastName" I know I can just to this on the query: SELECT PersNbr, (PersFirstName || PersMiddleName || PersLastName) PersName and then just do this: comboBox.DisplayMember = "PersName"; but I
                      Read more

                      Is it possible to collect Nectar points via Trainline?

                      Image
                      2 Since I am not eligible for any Railcard, the only available discount/bonus scheme is Nectar Card for me. GWR, SWR, LNER and Virgin Trains allow to collect Nectar points and I have already linked a card to my GWR account. A friend suggested me to use Trainline App, because it can search for bus tickets either. I had a look at the application, but could not see any option for Nectar. Is there a way to collect Nectar points when I buy tickets via Trainline? uk trains loyalty-programs trainline share | improve this question asked Dec 2 '18 at 15:50 ahmedus 3,224 5 19 49
                      Read more