row count at each step
You should be able to see the # of rows output after each step of the etl flow.
Comments
-
I love this idea, and it's something I've been thinking about as well. I will review with the team. I had a follow-up question - would you want to see these row counts while you're authoring the DataFlow (as part of the Preview process), or after the DataFlow runs in the DataFlow Execution Details?
Domo Product Manager for Data Transformation (MagicETL)
0 -
Hi @AndreaLovesData, I'm not sure which option @ydigilov would prefer but for me, having this ability while authoring the dataflow as part of the previous process would be awesome.
1 -
Being able to see row counts without having to run the ETL would allow you to more quickly ad easily see errors in your etl build-out.
1 -
@AndreaLovesData Just seeing now that you asked that question. I don't care if I have to hit run preview or if it automatically shows - if that's what you're asking. I just hate to have to output a new dataset at each step to see how many rows there are. I would hope that at least after hitting run preview, it would give us how many rows are in each step.
1 -
I just came on to add this. It would be so helpful to make sure filters, remove duplicates, and joins are behaving as expected. Especially in consumption models where you don't want to run it and then find out there is a problem.
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 744 Beast Mode
- 58 App Studio
- 41 Variables
- 686 Automate
- 176 Apps
- 453 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 395 Distribute
- 113 Domo Everywhere
- 276 Scheduled Reports
- 6 Software Integrations
- 125 Manage
- 122 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive