Snapshot Dataflow

helpme12345
Member
in Magic ETL
I have a current dataflow that is recursive. I want to make sure the company records that are being snapshotted are.
I am planning to use a field "Snapshot Date" which is the current date timestamp on the recursive.
How would I go about assuring the companies are being snapshotted daily in the ETL? Would I need to match back the final dataflow to the original recursive? Any guidance here would be amazing :)
0
Answers
-
@renee12345 this is actually a great use case for Partitioning in Magic. We current have it in beta. If you would be open to being part of the test. Contact your CSM and we can help.
0 -
Okay.
Any recommendations in the interim?
0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 656 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 811 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 80 App Studio
- 45 Variables
- 771 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 77 Workflows
- 23 Code Engine
- 36 AI and Machine Learning
- 19 AI Chat
- AI Playground
- AI Projects and Models
- 17 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 142 Manage
- 138 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive