Update Dataflow with multiple datasources (AND/OR function)
Hi there,
I think it would be necessary to adapt update methods for Dataflows.
Currently it is possible to update "on demand" when another dataflow or datasource was updated. This is problematic when using more than one datasource, because that means that DOMO starts updating when one of the datasources is finished and neglects the status of all other sources.
I read about the same issue a few times in DOJO, but the workaround by using schedules is likely unefficient and risky.
Example:
Dataflow A has 3 sources: Dataflow 1, Dataflow 2 and Dataset 3
Currently I can set update when either 1,2,3 are updated, but I cannot set update to: when 1,2,3 are updated completly then update Dataflow A.
Therefore it happend that Dataflow A was updated, because Dataflow 1 was finished although Dataflow 2 is still running, which results in wrong figures.
Using a time schedule will most likely reduce that risk, but first of all I need to calculate possible running times, which can change over time and secondly we will lose time, because there must be a safety gap. Furthermore setting schedules can be very confusing depending the complexity and quantity of datasources and dataflows.
I am very sure that this issue was already reported, but I wasn´t able to find any relating post.
The solution:
Add and/or to the update method, so I can request that all sources or specific sources are fully updated before starting the new update process.
Many thanks
Categories
- 10.5K All Categories
- 8 Connect
- 918 Connectors
- 250 Workbench
- 470 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 477 Datasets
- 194 Visualize
- 253 Beast Mode
- 2.1K Charting
- 11 Variables
- 17 Automate
- 354 APIs & Domo Developer
- 89 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 247 Distribute
- 63 Domo Everywhere
- 243 Scheduled Reports
- 21 Manage
- 42 Governance & Security
- 174 Product Ideas
- 1.2K Ideas Exchange
- 12 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive