Magic ETL

Magic ETL

Partition data from a historical date

I currently have an ETL that my team created yesterday, and it is partitioning data as of yesterday so there is currently 2 days of data in the data set. Is it possible to add historical data to a newly partitioned data set? Or is it possible to have the ETL partition off of a historical start date?

Answers

  • @Miaomichi How do you have the partitions set up?

  • image.png

    Hi Michelle! Thanks for responding. Attached is the ETL structure that my team member and I came up with. Our goal is to recreate a report from our ERP that allows you to capture AR Aging on a specified date. Currently our ETL has data from today and yesterday, but we would like to have historical data.

Welcome!

It looks like you're new here. Members get access to exclusive content, events, rewards, and more. Sign in or register to get started.
Sign In