Updating a Table through Workbench

I have a SQL table that gets constantly updated. Meaning, the old entries in the table get updated all the time. I connected this table through DOMO workbench and chose that the update method should be 'Append' instead of 'Replace'. However, it just adds new entries instead of updating existing data. Is there any way to update such a table to have new entries brought in and update existing entries without replacing the entire table? It's a very large table and I do not want to update the entire table daily.
Answers
-
The way I approach this with workbench is to treat any data I bring into domo as a stage via replace instead of append. Then I use a recursive MagicETL with partition processing to take that data from stage and merge it into my final output dataset.
@jaeW_at_Onyx has a good series of videos on this topic below. I hope this helps!
0 -
Using an ETL doesn't help as I would still have to update the entire dataset first.
0 -
I would take a look at the Upsert option in Workbench
https://domo-support.domo.com/s/article/360043038714?language=en_US
**Check out my Domo Tips & Tricks Videos
**Make sure toany users posts that helped you.
**Please mark as accepted the ones who solved your issue.0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 656 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 813 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 81 App Studio
- 45 Variables
- 771 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 77 Workflows
- 23 Code Engine
- 36 AI and Machine Learning
- 19 AI Chat
- AI Playground
- AI Projects and Models
- 17 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 142 Manage
- 138 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive