Managing Data Retention Policy

amehdad

Currently, there's no feature to create and manage custom rules for handling historical data within datasets. Companies have specific rules on how long they are allowed to keep different types of data and it looks like it is not easy to enforce this in Domo. 

There should be settings in DataSets where we can define conditions and scheduling on the checks and actions to execute (e.g. Which data to archive or remove entirely from storage). 

GrantSmith

You could utilize Magic ETL dataflows to check the date on the data and either split it out and archive it or remove it from the dataset depending on your company's data retention policy.

jaeW_at_Onyx

this can be automated via APIs. use the DatasetAPI or QueryAPI to find out it's age.

https://developer.domo.com/docs/dataset-api-reference/dataset#Delete%20a%20DataSet

the tough part will be if you want to retire rows of data (as opposed to entire datasets). you'll need a recursive query with a partitioning model to drop old data.

also in the java cli there are functions to assist with setting the retention policy.

amehdad

Some interesting options gents but surely there could a more convenient solution towards lean data instances.