Dataflow Run based on All input Dataset refresh Time

Aditya_Jain
Contributor

We are facing a big issue. Let's say I have 2 data sets 'A' and 'B' and these are used as input datasets in a ETL flow. I have set the dataflow setting as - 'Run each time Data set 'A' or 'B' refreshes'.
Problem statement -
Let's say Dataset A got refreshed before Dataset B, so the ETL/Dataflow would start running as soon as Dataset A got refershed. Meanwhile, the Dataset B also got refreshed, but since the dataflow is already running, those changes in dataset B would not be applied to the final output Dataset.
This problem becomes even bigger where we have multiple source as inputs.
'Happy to Help'
Tagged:
2
This discussion has been closed.
Categories
- 10.5K All Categories
- 8 Connect
- 918 Connectors
- 250 Workbench
- 470 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 477 Datasets
- 193 Visualize
- 252 Beast Mode
- 2.1K Charting
- 11 Variables
- 17 Automate
- 354 APIs & Domo Developer
- 89 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 247 Distribute
- 63 Domo Everywhere
- 243 Scheduled Reports
- 21 Manage
- 42 Governance & Security
- 174 Product Ideas
- 1.2K Ideas Exchange
- 12 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive