Snapshot Historical Data

user09742

I'm appending daily data for historical use. Because of the size I don't want store all of the history. I just want the last 8 days only and remove the other dates. How can I do this in ETL? I can filter for the last 8 days, but it still stores other dates data.

mhouston

You can do this via a recursive data flow - your daily update would be a replace dataset and you'd have a second dataset that has your 8 days historic data. You can refer to the kb article for details on building it out: https://domohelp.domo.com/hc/en-us/articles/360043428113-Creating-a-Recursive-Snapshot-Magic-ETL-DataFlow