Error while trying to use --boundary-query argument in sqoop import











up vote
0
down vote

favorite












I am learning sqoop on my own and tried to run the below mentioned code to retrieve the first 3000 records from the database and evenly split by primary key emp_no



 sqoop import 



 --connect jdbc:mysql://localhost/employees 



 --username root 



 -P 



--query 'select * from employees WHERE $CONDITIONS ORDER BY emp_no LIMIT 3000' 



--split-by emp_no 



-m 3 



--target-dir sqoop/import_data/employee_db_import 



--delete-target-dir


The above statements yielded evenly distributed results 1000 records per mapper.



Now for further learning I added the --boundary-query argument as



 --boundary-query 'select MIN(emp_no),MAX(emp_no) from employees'


to the above statement and the map reduce job is now reading 9000 records from the database. I want to know why is this happening ?






mysql hadoop mapreduce sqoop







share|improve this question


























    up vote
    0
    down vote

    favorite












    I am learning sqoop on my own and tried to run the below mentioned code to retrieve the first 3000 records from the database and evenly split by primary key emp_no



     sqoop import 
    

    
 --connect jdbc:mysql://localhost/employees 
    

    
 --username root 
    

    
 -P 
    

    
--query 'select * from employees WHERE $CONDITIONS ORDER BY emp_no LIMIT 3000' 
    

    
--split-by emp_no 
    

    
-m 3 
    

    
--target-dir sqoop/import_data/employee_db_import 
    

    
--delete-target-dir


    The above statements yielded evenly distributed results 1000 records per mapper.



    Now for further learning I added the --boundary-query argument as



     --boundary-query 'select MIN(emp_no),MAX(emp_no) from employees'


    to the above statement and the map reduce job is now reading 9000 records from the database. I want to know why is this happening ?






    mysql hadoop mapreduce sqoop







    share|improve this question
























      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      I am learning sqoop on my own and tried to run the below mentioned code to retrieve the first 3000 records from the database and evenly split by primary key emp_no



       sqoop import 
      

      
 --connect jdbc:mysql://localhost/employees 
      

      
 --username root 
      

      
 -P 
      

      
--query 'select * from employees WHERE $CONDITIONS ORDER BY emp_no LIMIT 3000' 
      

      
--split-by emp_no 
      

      
-m 3 
      

      
--target-dir sqoop/import_data/employee_db_import 
      

      
--delete-target-dir


      The above statements yielded evenly distributed results 1000 records per mapper.



      Now for further learning I added the --boundary-query argument as



       --boundary-query 'select MIN(emp_no),MAX(emp_no) from employees'


      to the above statement and the map reduce job is now reading 9000 records from the database. I want to know why is this happening ?






      mysql hadoop mapreduce sqoop







      share|improve this question













      I am learning sqoop on my own and tried to run the below mentioned code to retrieve the first 3000 records from the database and evenly split by primary key emp_no



       sqoop import 
      

      
 --connect jdbc:mysql://localhost/employees 
      

      
 --username root 
      

      
 -P 
      

      
--query 'select * from employees WHERE $CONDITIONS ORDER BY emp_no LIMIT 3000' 
      

      
--split-by emp_no 
      

      
-m 3 
      

      
--target-dir sqoop/import_data/employee_db_import 
      

      
--delete-target-dir


      The above statements yielded evenly distributed results 1000 records per mapper.



      Now for further learning I added the --boundary-query argument as



       --boundary-query 'select MIN(emp_no),MAX(emp_no) from employees'


      to the above statement and the map reduce job is now reading 9000 records from the database. I want to know why is this happening ?






      mysql hadoop mapreduce sqoop




      mysql hadoop mapreduce sqoop






      share|improve this question













      share|improve this question











      share|improve this question




      share|improve this question










      asked yesterday









      Sarvagya Dubey

      699




      699





























          active

          oldest

          votes











          Your Answer






          StackExchange.ifUsing("editor", function () {
          StackExchange.using("externalEditor", function () {
          StackExchange.using("snippets", function () {
          StackExchange.snippets.init();
          });
          });
          }, "code-snippets");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "1"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });














           

          draft saved


          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53265727%2ferror-while-trying-to-use-boundary-query-argument-in-sqoop-import%23new-answer', 'question_page');
          }
          );

          Post as a guest























          active

          oldest

          votes













          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes
















           

          draft saved


          draft discarded



















































           


          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53265727%2ferror-while-trying-to-use-boundary-query-argument-in-sqoop-import%23new-answer', 'question_page');
          }
          );

          Post as a guest






































































          -

          Popular posts from this blog

          Biblatex bibliography style without URLs when DOI exists (in Overleaf with Zotero bibliography)

          Image
          2 2 I have a Zotero bibliography in Overleaf. I use biblatex . usepackage[backend=biber,citestyle=authoryear]{biblatex} addbibresource{zoteroALH.bib} Bibliography entries look like: @book{de_saint-gervais_uniformization_2016, title = {Uniformization of {Riemann} {Surfaces}}, isbn = {978-3-03719-145-3}, url = {https://www.ems-ph.org/books/book.php?proj_nr=198&srch=series%7Chem}, urldate = {2019-02-03}, author = {de Saint-Gervais, Paul Henri}, year = {2016}, doi = {10.4171/145} } In the bibliography down the paper the reference shows like this: There is the DOI, great, but also the URL which is unnecessary when the DOI is there. How can I remove the URL when the DOI is present? biblatex bibliographies overleaf zote
          Read more

          ComboBox Display Member on multiple fields

          Image
          2 I'm trying to set the .DisplayMember property of a ComboBox in C#, but I want to bind it to multiple columns in the .DataSouce . My SQL looks like this: SELECT PersNbr, PersFirstName, PersMiddleName, PersLastName FROM Pers WHERE PersNbr = :persNbr; I'm saving this query in a DataTable so each column selected has it's own column in the Datatable . I want to make the .DisplayMember a combination of PersFirstName + PersMiddleName + PersLastName so their full name appears like this: comboBox.DisplayMemeber = "PersFirstName" + "PersMiddleName" + "PersLastName" I know I can just to this on the query: SELECT PersNbr, (PersFirstName || PersMiddleName || PersLastName) PersName and then just do this: comboBox.DisplayMember = "PersName"; but I
          Read more

          Is it possible to collect Nectar points via Trainline?

          Image
          2 Since I am not eligible for any Railcard, the only available discount/bonus scheme is Nectar Card for me. GWR, SWR, LNER and Virgin Trains allow to collect Nectar points and I have already linked a card to my GWR account. A friend suggested me to use Trainline App, because it can search for bus tickets either. I had a look at the application, but could not see any option for Nectar. Is there a way to collect Nectar points when I buy tickets via Trainline? uk trains loyalty-programs trainline share | improve this question asked Dec 2 '18 at 15:50 ahmedus 3,224 5 19 49
          Read more