Is there a way to remove historical data from an "appending" DataSet.
Is there a way to remove rows/data from a DataSet that has been appending rows since its creation?
The data I need to remove is older so it is not able to be removed from the History tab, nor is the data from a single upload anyways.
As the DataSet is also a Legacy DataSet from a credit usage point of view, a new DataFlow/DataSet to remove the data is not an option.
One of the DataSet is collected by email and it so so big at this state that coping all the data, wiping the DataSet and then reuploading the needed data is also not an option.
Answers
-
You might be able to utilize the Java CLI with the delete-rows command to delete specific upsert keys in your dataset. If you need to define an upsert key on your dataset you can use the define-upsert command.
As a precaution, I'd recommend backing up your dataset and trying out on a copy first before modifying the original.
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0 -
Ok, thanks, ill give that a try. I was hoping for something more user friendly in all honesty
In principle I could just download the dataset, modify it and then reupload? Should be an easier operation I would imagine.
0 -
You could certainly download, re-upload, and then create a dataflow that appends your scheduled data to your newly uploaded dataset.
If your datasets are the result of a dataflow, you could also use a recursive dataflow where you use the dataset as it's own input and output, then filter out the rows you don't want to keep. Be sure to test and keep a backup of your data with this approach until you're sure you've got it right!
Creating a Recursive/Snapshot DataFlow in Magic ETL (domo.com)
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 747 Beast Mode
- 59 App Studio
- 41 Variables
- 686 Automate
- 176 Apps
- 453 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 395 Distribute
- 113 Domo Everywhere
- 276 Scheduled Reports
- 6 Software Integrations
- 125 Manage
- 122 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive