Partition data from a historical date

Options
Miaomichi
Miaomichi Member
in Magic ETL

I currently have an ETL that my team created yesterday, and it is partitioning data as of yesterday so there is currently 2 days of data in the data set. Is it possible to add historical data to a newly partitioned data set? Or is it possible to have the ETL partition off of a historical start date?

Answers

  • MichelleH
    MichelleH Coach

    @Miaomichi How do you have the partitions set up?

  • Miaomichi
    Miaomichi Member
    image.png

    Hi Michelle! Thanks for responding. Attached is the ETL structure that my team member and I came up with. Our goal is to recreate a report from our ERP that allows you to capture AR Aging on a specified date. Currently our ETL has data from today and yesterday, but we would like to have historical data.

Categories