TensorFlow Estimator BestExporter event_file_pattern doesn't do anything












1















I have a colab with a very simple demo Estimator for the sole purpose of learning / understanding the Estimator api with the goal of making a convention for a plug-and-play model with common bells and whistles of the trade in tack (e.g. early stopping if the validation set stops improving, exporting the model, etc).



In the cell where I define the BestExporter I have:



exporter = tf.estimator.BestExporter(
name="best_exporter",
serving_input_receiver_fn=serving_input_receiver_fn,
# event_file_pattern="model_*", # <--- doesn't do anything?
exports_to_keep=5
) # this will keep the 5 best checkpoints


which currently exports my best models under



<MODEL_DIR>/export/best_exporter/<some_number>


where MODEL_DIR=./test (under the cell setup > constants and specified in the RunConfig set in estimator functions > run config)



If I uncomment event_file_pattern="model_*", I expected to see my model be exported to <MODEL_DIR>/export/best_exporter/model_<number>, but it doesn't.



So how do I specify what my models should be called?



For example, in the colab I track the metrics mse and mae.



How would I get the 5 best exports_to_keep be saved as:



MODEL_DIR/export/best_exporter/<model_name>_mae_<mae-rounded-to-3-decimals>


?










share|improve this question



























    1















    I have a colab with a very simple demo Estimator for the sole purpose of learning / understanding the Estimator api with the goal of making a convention for a plug-and-play model with common bells and whistles of the trade in tack (e.g. early stopping if the validation set stops improving, exporting the model, etc).



    In the cell where I define the BestExporter I have:



    exporter = tf.estimator.BestExporter(
    name="best_exporter",
    serving_input_receiver_fn=serving_input_receiver_fn,
    # event_file_pattern="model_*", # <--- doesn't do anything?
    exports_to_keep=5
    ) # this will keep the 5 best checkpoints


    which currently exports my best models under



    <MODEL_DIR>/export/best_exporter/<some_number>


    where MODEL_DIR=./test (under the cell setup > constants and specified in the RunConfig set in estimator functions > run config)



    If I uncomment event_file_pattern="model_*", I expected to see my model be exported to <MODEL_DIR>/export/best_exporter/model_<number>, but it doesn't.



    So how do I specify what my models should be called?



    For example, in the colab I track the metrics mse and mae.



    How would I get the 5 best exports_to_keep be saved as:



    MODEL_DIR/export/best_exporter/<model_name>_mae_<mae-rounded-to-3-decimals>


    ?










    share|improve this question

























      1












      1








      1








      I have a colab with a very simple demo Estimator for the sole purpose of learning / understanding the Estimator api with the goal of making a convention for a plug-and-play model with common bells and whistles of the trade in tack (e.g. early stopping if the validation set stops improving, exporting the model, etc).



      In the cell where I define the BestExporter I have:



      exporter = tf.estimator.BestExporter(
      name="best_exporter",
      serving_input_receiver_fn=serving_input_receiver_fn,
      # event_file_pattern="model_*", # <--- doesn't do anything?
      exports_to_keep=5
      ) # this will keep the 5 best checkpoints


      which currently exports my best models under



      <MODEL_DIR>/export/best_exporter/<some_number>


      where MODEL_DIR=./test (under the cell setup > constants and specified in the RunConfig set in estimator functions > run config)



      If I uncomment event_file_pattern="model_*", I expected to see my model be exported to <MODEL_DIR>/export/best_exporter/model_<number>, but it doesn't.



      So how do I specify what my models should be called?



      For example, in the colab I track the metrics mse and mae.



      How would I get the 5 best exports_to_keep be saved as:



      MODEL_DIR/export/best_exporter/<model_name>_mae_<mae-rounded-to-3-decimals>


      ?










      share|improve this question














      I have a colab with a very simple demo Estimator for the sole purpose of learning / understanding the Estimator api with the goal of making a convention for a plug-and-play model with common bells and whistles of the trade in tack (e.g. early stopping if the validation set stops improving, exporting the model, etc).



      In the cell where I define the BestExporter I have:



      exporter = tf.estimator.BestExporter(
      name="best_exporter",
      serving_input_receiver_fn=serving_input_receiver_fn,
      # event_file_pattern="model_*", # <--- doesn't do anything?
      exports_to_keep=5
      ) # this will keep the 5 best checkpoints


      which currently exports my best models under



      <MODEL_DIR>/export/best_exporter/<some_number>


      where MODEL_DIR=./test (under the cell setup > constants and specified in the RunConfig set in estimator functions > run config)



      If I uncomment event_file_pattern="model_*", I expected to see my model be exported to <MODEL_DIR>/export/best_exporter/model_<number>, but it doesn't.



      So how do I specify what my models should be called?



      For example, in the colab I track the metrics mse and mae.



      How would I get the 5 best exports_to_keep be saved as:



      MODEL_DIR/export/best_exporter/<model_name>_mae_<mae-rounded-to-3-decimals>


      ?







      python tensorflow tensorflow-serving tensorflow-estimator






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked Nov 21 '18 at 10:03









      SumNeuronSumNeuron

      1,231826




      1,231826
























          0






          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          autoActivateHeartbeat: false,
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














          draft saved

          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409547%2ftensorflow-estimator-bestexporter-event-file-pattern-doesnt-do-anything%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown

























          0






          active

          oldest

          votes








          0






          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















          draft saved

          draft discarded




















































          Thanks for contributing an answer to Stack Overflow!


          • Please be sure to answer the question. Provide details and share your research!

          But avoid



          • Asking for help, clarification, or responding to other answers.

          • Making statements based on opinion; back them up with references or personal experience.


          To learn more, see our tips on writing great answers.




          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409547%2ftensorflow-estimator-bestexporter-event-file-pattern-doesnt-do-anything%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

          ComboBox Display Member on multiple fields

          Is it possible to collect Nectar points via Trainline?