prioritize recent data for input datasets in dataflows for preview


We all run into the situation where we have two tables with hundreds of million of rows and we drop them in the dataflow and know that our join transforms will never match up. Could we get the most recent 10k rows from the input datasets rather than something seemingly random? That would really boost our ability to validate that SQL as we go along.
Comments
-
I really need this. It's so hard to validate data without being able to control what records come through in a preview. I also really think a sort tile would be super useful. I realize you can do this with the Rank and Window tile, but dropping in a sort tile would be much simpler.
0 -
I would like to amend this request. Rather than simply prioritizing recent data, as I requested at Domopalooza 2024, I would like the ability to filter the datasets being brought in. Let me hit that 100k row limit based on attributes in the data. This would make dataflows an invaluable tool for tracking down data anomalies and simply understanding the datasets better without having to run the dataflow and check results.
3 -
@WHM - I've requested the same. I'd just like to see 'WHERE' clause features on input tiles so I can filter directly from the source. This would also reduce ETL processing time and load on downstream systems trying to feed all the data to Domo before it passes through a filter tile.
1
Categories
- All Categories
- Product Ideas
- 2.1K Ideas Exchange
- Connect
- 1.3K Connectors
- 309 Workbench
- 7 Cloud Amplifier
- 10 Federated
- Transform
- 663 Datasets
- 119 SQL DataFlows
- 2.3K Magic ETL
- 823 Beast Mode
- Visualize
- 2.6K Charting
- 86 App Studio
- 46 Variables
- Automate
- 193 Apps
- 483 APIs & Domo Developer
- 87 Workflows
- 23 Code Engine
- AI and Machine Learning
- 23 AI Chat
- 4 AI Projects and Models
- 18 Jupyter Workspaces
- Distribute
- 117 Domo Everywhere
- 283 Scheduled Reports
- 11 Software Integrations
- Manage
- 143 Governance & Security
- 11 Domo Community Gallery
- 49 Product Releases
- 13 Domo University
- Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 116 Community Announcements
- 5K Archive