Conditional ETL Run
Hey experts
I have Sales data for US states with two columns - State, Sales.
The data is received in Google sheet and I want to make sure that there is no typo in the State column, prior to using it in Magic ETL.
I created a master data that contains all the correct state names. I then right joined my Sales Data with master data with filter “State is null” using SQL data flow. This gives me all rows with misspelled State names in my Sales Data. The output is called “Misspelled States”
Next, I want to run my Magic ETL only if “Misspelled States” is empty.
Is it possible to do that in Domo? Any other suggestions on how this can be achieved will be highly appreciated.
Regards
Comments
-
Hnrgh...
well ... no. you can't conditionally run execution. What you could do is count the number of errors and export that with your first pass ETL (although, I would probably just integrate both ETLs into one stage).
if you have a recursive dataflow in place you could set the rule "if countOfErrors = 0 then ... replace your sales data witth new ETL" and "if count ofErrors > 1 then output the input dataset without changes."
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨💻
**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0
Categories
- 10.5K All Categories
- 8 Connect
- 918 Connectors
- 250 Workbench
- 470 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 477 Datasets
- 194 Visualize
- 253 Beast Mode
- 2.1K Charting
- 11 Variables
- 17 Automate
- 354 APIs & Domo Developer
- 89 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 247 Distribute
- 63 Domo Everywhere
- 243 Scheduled Reports
- 21 Manage
- 42 Governance & Security
- 174 Product Ideas
- 1.2K Ideas Exchange
- 12 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive