Dataflow Run based on All input Dataset refresh Time
We are facing a big issue. Let's say I have 2 data sets 'A' and 'B' and these are used as input datasets in a ETL flow. I have set the dataflow setting as - 'Run each time Data set 'A' or 'B' refreshes'.
Problem statement -
Let's say Dataset A got refreshed before Dataset B, so the ETL/Dataflow would start running as soon as Dataset A got refershed. Meanwhile, the Dataset B also got refreshed, but since the dataflow is already running, those changes in dataset B would not be applied to the final output Dataset.
This problem becomes even bigger where we have multiple source as inputs.
'Happy to Help'
Tagged:
2
This discussion has been closed.
Categories
- 7.7K All Categories
- 5 Connect
- 921 Connectors
- 244 Workbench
- 479 Transform
- 1.8K Magic ETL
- 60 SQL DataFlows
- 446 Datasets
- 49 Visualize
- 202 Beast Mode
- 2K Charting
- 8 Variables
- 1 Automate
- 348 APIs & Domo Developer
- 82 Apps
- Workflows
- 14 Predict
- 3 Jupyter Workspaces
- 11 R & Python Tiles
- 241 Distribute
- 59 Domo Everywhere
- 241 Scheduled Reports
- 15 Manage
- 36 Governance & Security
- 37 Product Ideas
- 1.1K Ideas Exchange
- 2 Community Forums
- 15 Getting Started
- 2 Community Member Introductions
- 50 Community News
- 18 Event Recordings
- 579 日本支部