Discussions
-
Run only when all input datasets have been updated
Please add a run trigger that will trigger only when ALL the input datasets I selected have been updated. That applies to both Magic ETL and Jupyter notebook. Currently, when setting a run trigger and adding a condition to run when selected input datasets have been updated since the last successful run, the dataflow will…
-
Trigger a workflow only when ALL the input datasets I selected have been updated
Most of our Magic ETL and Jupyter notebooks workflows require a trigger that triggers only when ALL the input datasets I selected have been updated. We update input datasets from Workbench. Larger datasets take longer to update than smaller ones. The Magic ETL must run only when all the input datasets are up to date, and…