Updating a Table through Workbench
I have a SQL table that gets constantly updated. Meaning, the old entries in the table get updated all the time. I connected this table through DOMO workbench and chose that the update method should be 'Append' instead of 'Replace'. However, it just adds new entries instead of updating existing data. Is there any way to update such a table to have new entries brought in and update existing entries without replacing the entire table? It's a very large table and I do not want to update the entire table daily.
Answers
-
The way I approach this with workbench is to treat any data I bring into domo as a stage via replace instead of append. Then I use a recursive MagicETL with partition processing to take that data from stage and merge it into my final output dataset.
@jaeW_at_Onyx has a good series of videos on this topic below. I hope this helps!
0 -
Using an ETL doesn't help as I would still have to update the entire dataset first.
0 -
I would take a look at the Upsert option in Workbench
https://domo-support.domo.com/s/article/360043038714?language=en_US
**Check out my Domo Tips & Tricks Videos
**Make sure to any users posts that helped you.
**Please mark as accepted the ones who solved your issue.0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 754 Beast Mode
- 61 App Studio
- 41 Variables
- 693 Automate
- 178 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive