DataSet Input Limitations
I am buinling a DataFlow and need to use a DataSet that has 4.5 million records. The problem is that I cannot input all of the 4.5m records into my DataFlow. I see a dropdown next to the word "Loaded" with the selection of 10k, 100k and 500k. This seems to suggest that I can only input from a DataSet at most only 500000 records. How can I get around this? Am I missing something here?
-Mark
Comments
-
Hi Mark,
That dropdown you are seeing of 10k, 100k, and 500k only applies to previews of transforms you perform while you are building your dataflow (you can run a preview of each of your transforms). When you complete your dataflow and run it, the full 4.5 million records will be included.
You are limited in rows while running previews for performance reasons, and it will help you validate your transforms quicker.
Let me know if this helps!
5 -
@markrenson, did Clarke's reply help address your issue?
0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 656 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 811 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 80 App Studio
- 45 Variables
- 771 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 77 Workflows
- 23 Code Engine
- 36 AI and Machine Learning
- 19 AI Chat
- AI Playground
- AI Projects and Models
- 17 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 142 Manage
- 138 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive