Options for Preview Run Limits in Magic ETL


The Magic ETL currently only max out at 400k row for the preview run from your input datasets. This is limiting the test preview in your flow as it only picks (from my understanding) the first 400k row of your dataset. So if you're trying to preview your actions (such as filtering) you may not get anything showing in the preview if the value which you are filtering only exists from row 400,001 onwards.
Suggestions for Domo team could be:
- Remove limit
- Allow user to select row limits by datasets
- Allow users to select dataset row ranges if the limit has to remain, for example, if Domo needs to stay with the 400k limit, then allow users to select which rows range for the limit to be applied, i.e. row 200,000 to 600,000
- Keep existing limit but allowing additional limit parameters such as date range, i.e. set 400k limit for MMM to MMM of YYYY
Comments
-
This suggestion would be invaluable for us as well. In particular, #4 would be fantastic, especially if we could functionally apply a simple WHERE clause to the input (i.e. SELECT * FROM [DATASET] WHERE [CONDITION] LIMIT 10000).
1 -
I wish I can also filter the columns in the preview mode.
0 -
I agree.
The previews also prevent important examining of the data during joins. I've created an idea for this too:
The Magic ETL needs to include more functionality in the GUI for testing.
Alternatively a game-changer would be an option to convert the ETL to a SQL window with boilerplat tests and running as you would see in a SQL IDE.
0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 310 Workbench
- 7 Cloud Amplifier
- 9 Federated
- 3K Transform
- 114 SQL DataFlows
- 654 Datasets
- 2.2K Magic ETL
- 4K Visualize
- 2.5K Charting
- 796 Beast Mode
- 78 App Studio
- 44 Variables
- 757 Automate
- 188 Apps
- 480 APIs & Domo Developer
- 72 Workflows
- 17 DomoAI
- 40 Predict
- 17 Jupyter Workspaces
- 23 R & Python Tiles
- 408 Distribute
- 119 Domo Everywhere
- 279 Scheduled Reports
- 10 Software Integrations
- 141 Manage
- 137 Governance & Security
- 8 Domo Community Gallery
- 47 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive