Updating a Table through Workbench
I have a SQL table that gets constantly updated. Meaning, the old entries in the table get updated all the time. I connected this table through DOMO workbench and chose that the update method should be 'Append' instead of 'Replace'. However, it just adds new entries instead of updating existing data. Is there any way to update such a table to have new entries brought in and update existing entries without replacing the entire table? It's a very large table and I do not want to update the entire table daily.
Answers
-
The way I approach this with workbench is to treat any data I bring into domo as a stage via replace instead of append. Then I use a recursive MagicETL with partition processing to take that data from stage and merge it into my final output dataset.
@jaeW_at_Onyx has a good series of videos on this topic below. I hope this helps!
0 -
Using an ETL doesn't help as I would still have to update the entire dataset first.
0 -
I would take a look at the Upsert option in Workbench
https://domo-support.domo.com/s/article/360043038714?language=en_US
**Check out my Domo Tips & Tricks Videos
**Make sure to any users posts that helped you.
**Please mark as accepted the ones who solved your issue.0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 678 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 46 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive