Updating a Table through Workbench
I have a SQL table that gets constantly updated. Meaning, the old entries in the table get updated all the time. I connected this table through DOMO workbench and chose that the update method should be 'Append' instead of 'Replace'. However, it just adds new entries instead of updating existing data. Is there any way to update such a table to have new entries brought in and update existing entries without replacing the entire table? It's a very large table and I do not want to update the entire table daily.
Answers
-
The way I approach this with workbench is to treat any data I bring into domo as a stage via replace instead of append. Then I use a recursive MagicETL with partition processing to take that data from stage and merge it into my final output dataset.
@jaeW_at_Onyx has a good series of videos on this topic below. I hope this helps!
0 -
Using an ETL doesn't help as I would still have to update the entire dataset first.
0 -
I would take a look at the Upsert option in Workbench
https://domo-support.domo.com/s/article/360043038714?language=en_US
**Check out my Domo Tips & Tricks Videos
**Make sure to any users posts that helped you.
**Please mark as accepted the ones who solved your issue.0
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 303 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3K Transform
- 104 SQL DataFlows
- 640 Datasets
- 2.2K Magic ETL
- 4K Visualize
- 2.5K Charting
- 769 Beast Mode
- 72 App Studio
- 43 Variables
- 718 Automate
- 185 Apps
- 462 APIs & Domo Developer
- 57 Workflows
- 14 DomoAI
- 40 Predict
- 17 Jupyter Workspaces
- 23 R & Python Tiles
- 402 Distribute
- 116 Domo Everywhere
- 277 Scheduled Reports
- 9 Software Integrations
- 135 Manage
- 132 Governance & Security
- 8 Domo Community Gallery
- 44 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 111 Community Announcements
- 4.8K Archive