How to update field if value is different than existing?
Hello,
I feel like this should be straightforward, but I can't figure it out. During our master ETL, I have a lookup sheet that adds fields to the dataset (e.g. Account Owner, Region, Account tier (A, B, or C). However, if an account owner changes and I make a change to the lookup sheet, it's only updating new records since we are updating the dataset by batch. All prior records retain the old value. Is there an easy way to update all records without rerunning the entire dataset?
I'd even be fine with filtering the output dataset and remapping, but it looks like that applies the change to all records and not just the filtered rows.
Sorry, very new to this.
Thanks, Brian
Best Answer
-
I would recommend joining this data in using a dataset view. These joins happen much faster than ETLs (near instant). The downside here would be that you would need to change any cards or content you have built to a new dataset.
0
Answers
-
Pretty sure you'll have to re-run the entire dataset. Is there a reason you are against doing that one time to cleanup the account owners?
If I solved your problem, please select "yes" above
0 -
Thanks for the response. Last time I tried to do that, it timed-out after 24 hours.
0 -
Gotcha. Have you looked at using Magic ETL and/or Datafusion to speed things up and prevent a timeout?
If I solved your problem, please select "yes" above
0 -
I would recommend joining this data in using a dataset view. These joins happen much faster than ETLs (near instant). The downside here would be that you would need to change any cards or content you have built to a new dataset.
0
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 307 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3K Transform
- 112 SQL DataFlows
- 649 Datasets
- 2.2K Magic ETL
- 4K Visualize
- 2.5K Charting
- 790 Beast Mode
- 78 App Studio
- 43 Variables
- 745 Automate
- 187 Apps
- 475 APIs & Domo Developer
- 67 Workflows
- 16 DomoAI
- 40 Predict
- 17 Jupyter Workspaces
- 23 R & Python Tiles
- 406 Distribute
- 117 Domo Everywhere
- 279 Scheduled Reports
- 10 Software Integrations
- 139 Manage
- 136 Governance & Security
- 8 Domo Community Gallery
- 47 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 113 Community Announcements
- 4.8K Archive