Dataflow Run based on All input Dataset refresh Time

Aditya_Jain
Contributor

We are facing a big issue. Let's say I have 2 data sets 'A' and 'B' and these are used as input datasets in a ETL flow. I have set the dataflow setting as - 'Run each time Data set 'A' or 'B' refreshes'.
Problem statement -
Let's say Dataset A got refreshed before Dataset B, so the ETL/Dataflow would start running as soon as Dataset A got refershed. Meanwhile, the Dataset B also got refreshed, but since the dataflow is already running, those changes in dataset B would not be applied to the final output Dataset.
This problem becomes even bigger where we have multiple source as inputs.
'Happy to Help'
Tagged:
2
This discussion has been closed.
Categories
- 10.5K All Categories
- 3 Connect
- 913 Connectors
- 250 Workbench
- 458 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 476 Datasets
- 182 Visualize
- 249 Beast Mode
- 2.1K Charting
- 11 Variables
- 16 Automate
- 354 APIs & Domo Developer
- 88 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 245 Distribute
- 62 Domo Everywhere
- 242 Scheduled Reports
- 20 Manage
- 41 Governance & Security
- 168 Product Ideas
- 1.2K Ideas Exchange
- 9 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive