DataSet Input Limitations
I am buinling a DataFlow and need to use a DataSet that has 4.5 million records. The problem is that I cannot input all of the 4.5m records into my DataFlow. I see a dropdown next to the word "Loaded" with the selection of 10k, 100k and 500k. This seems to suggest that I can only input from a DataSet at most only 500000 records. How can I get around this? Am I missing something here?
-Mark
Comments
-
Hi Mark,
That dropdown you are seeing of 10k, 100k, and 500k only applies to previews of transforms you perform while you are building your dataflow (you can run a preview of each of your transforms). When you complete your dataflow and run it, the full 4.5 million records will be included.
You are limited in rows while running previews for performance reasons, and it will help you validate your transforms quicker.
Let me know if this helps!
5 -
@markrenson, did Clarke's reply help address your issue?
0
Categories
- All Categories
- Product Ideas
- 2.1K Ideas Exchange
- Data Connections
- 1.3K Connectors
- 309 Workbench
- 17 Cloud Integrations
- Data & ETL
- 2.3K Magic ETL
- 120 SQL DataFlows
- 667 Datasets
- Visualize & Apps
- 90 App Studio
- 198 Pro-code Components
- 2.6K Charting & Analyzer
- 874 Calculations & Variables (Beast Mode)
- AI & Data science
- 23 Domo AI & AI Chat
- 4 Managing AI
- 18 Jupyter Workspaces
- Automate
- 122 Workflows
- Alerts
- Distribute
- 118 Domo Everywhere
- 284 Reporting
- Manage
- 146 Governance & Security
- 489 APIs
- 11 Add-ins & Plugins
- 13 Domo Community Gallery
- 49 Product Releases
- 13 Domo University
- Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 118 Community Announcements
- 5K Archive