Conditional ETL Run
Hey experts
I have Sales data for US states with two columns - State, Sales.
The data is received in Google sheet and I want to make sure that there is no typo in the State column, prior to using it in Magic ETL.
I created a master data that contains all the correct state names. I then right joined my Sales Data with master data with filter “State is null” using SQL data flow. This gives me all rows with misspelled State names in my Sales Data. The output is called “Misspelled States”
Next, I want to run my Magic ETL only if “Misspelled States” is empty.
Is it possible to do that in Domo? Any other suggestions on how this can be achieved will be highly appreciated.
Regards
Comments
-
Hnrgh...
well ... no. you can't conditionally run execution. What you could do is count the number of errors and export that with your first pass ETL (although, I would probably just integrate both ETLs into one stage).
if you have a recursive dataflow in place you could set the rule "if countOfErrors = 0 then ... replace your sales data witth new ETL" and "if count ofErrors > 1 then output the input dataset without changes."
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨💻
**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 295 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 97 SQL DataFlows
- 608 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.4K Charting
- 710 Beast Mode
- 50 App Studio
- 39 Variables
- 668 Automate
- 170 Apps
- 446 APIs & Domo Developer
- 45 Workflows
- 7 DomoAI
- 33 Predict
- 13 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 116 Manage
- 113 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 103 Community Announcements
- 4.8K Archive