Updating a Table through Workbench
I have a SQL table that gets constantly updated. Meaning, the old entries in the table get updated all the time. I connected this table through DOMO workbench and chose that the update method should be 'Append' instead of 'Replace'. However, it just adds new entries instead of updating existing data. Is there any way to update such a table to have new entries brought in and update existing entries without replacing the entire table? It's a very large table and I do not want to update the entire table daily.
Answers
-
The way I approach this with workbench is to treat any data I bring into domo as a stage via replace instead of append. Then I use a recursive MagicETL with partition processing to take that data from stage and merge it into my final output dataset.
@jaeW_at_Onyx has a good series of videos on this topic below. I hope this helps!
0 -
Using an ETL doesn't help as I would still have to update the entire dataset first.
0 -
I would take a look at the Upsert option in Workbench
https://domo-support.domo.com/s/article/360043038714?language=en_US
**Check out my Domo Tips & Tricks Videos
**Make sure to any users posts that helped you.
**Please mark as accepted the ones who solved your issue.0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 295 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 97 SQL DataFlows
- 608 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.4K Charting
- 709 Beast Mode
- 49 App Studio
- 39 Variables
- 667 Automate
- 170 Apps
- 446 APIs & Domo Developer
- 44 Workflows
- 7 DomoAI
- 33 Predict
- 13 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 115 Manage
- 112 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 103 Community Announcements
- 4.8K Archive