DataSet Input Limitations

User_1826

I am buinling a DataFlow and need to use a DataSet that has 4.5 million records.  The problem is that I cannot input all of the 4.5m records into my DataFlow.  I see a dropdown next to the word "Loaded" with the selection of 10k, 100k and 500k.  This seems to suggest that I can only input from a DataSet at most only 500000 records.  How can I get around this?  Am I missing something here?

 

-Mark

Domo_Diesel

Hi Mark,

 

That dropdown you are seeing of 10k, 100k, and 500k only applies to previews of transforms you perform while you are building your dataflow (you can run a preview of each of your transforms).  When you complete your dataflow and run it, the full 4.5 million records will be included.

 

You are limited in rows while running previews for performance reasons, and it will help you validate your transforms quicker.

 

Let me know if this helps!

kshah008

@markrenson, did Clarke's reply help address your issue?