How to delete rows automatically based on a date in a dataset ?
I am inserting new rows in a dataset on daily basis, and now the dataset size has became huge since the rows are added daily. I want to delete the rows from this dataset based on date criteria (Dataset has a column type of "date" in it). So the criteria is like I want to maintain rows in dataset for last 30 days. eg assume I updated the dataset today (Nov 25) then dataset should only have rows (Oct 25 - Nov 25) and for tomorrow ie Nov 26 the dataset should have rows in range from (Oct 26 to Nov 26) and all the rows before Oct 26 should get deleted, if exist.
1. Is there a way I can do this?
2. Is there any API provided by DOMO that can be used to do programmatically?
Comments
-
Hi @user017486
I posted an answer to your question here: https://dojo.domo.com/t5/Beast-Mode-ETL-Dataflow/How-to-delete-rows-automatically-based-on-a-date-in-a-dataset/m-p/51468/highlight/true#M9105
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0 -
You probably should not truncate your dataset. (unless we're getting into Billions of rows AND you're confident the data has no value.) Today you might not want that data, but in five weeks if you change your mind it'll be borderline impossible to recover the data you threw away without reloading it.
I assume you're discarding data because it's cumbersome to handle in Dataflows.
You can use a DataSet View (domo beta feature speak to your CSM) to create a filter based on TODAY(), similar to the recursive query model @GrantSmith is proposing.
Jae Wilson
Check out my 🎥 Domo Training YouTube Channel 👨💻
**Say "Thanks" by clicking the ❤️ in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0
Categories
- All Categories
- 1.4K Product Ideas
- 1.4K Ideas Exchange
- 1.4K Connect
- 1.1K Connectors
- 282 Workbench
- 3 Cloud Amplifier
- 4 Federated
- 2.8K Transform
- 86 SQL DataFlows
- 548 Datasets
- 2.2K Magic ETL
- 3.2K Visualize
- 2.3K Charting
- 542 Beast Mode
- App Studio
- 26 Variables
- 566 Automate
- 134 Apps
- 411 APIs & Domo Developer
- 21 Workflows
- DomoAI
- 28 Predict
- 12 Jupyter Workspaces
- 16 R & Python Tiles
- 344 Distribute
- 86 Domo Everywhere
- 257 Scheduled Reports
- 1 Software Integrations
- 85 Manage
- 84 Governance & Security
- 6 Product Release Questions
- Community Forums
- 41 Getting Started
- 27 Community Member Introductions
- 81 Community Announcements
- 4.8K Archive