Snapshot Dataflow

helpme12345
Member
in Magic ETL
I have a current dataflow that is recursive. I want to make sure the company records that are being snapshotted are.
I am planning to use a field "Snapshot Date" which is the current date timestamp on the recursive.
How would I go about assuring the companies are being snapshotted daily in the ETL? Would I need to match back the final dataflow to the original recursive? Any guidance here would be amazing :)
0
Answers
-
@renee12345 this is actually a great use case for Partitioning in Magic. We current have it in beta. If you would be open to being part of the test. Contact your CSM and we can help.
0 -
Okay.
Any recommendations in the interim?
0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 660 Datasets
- 117 SQL DataFlows
- 2.2K Magic ETL
- 816 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 84 App Studio
- 46 Variables
- 778 Automate
- 190 Apps
- 482 APIs & Domo Developer
- 83 Workflows
- 23 Code Engine
- 41 AI and Machine Learning
- 20 AI Chat
- 1 AI Playground
- 2 AI Projects and Models
- 18 Jupyter Workspaces
- 412 Distribute
- 120 Domo Everywhere
- 281 Scheduled Reports
- 11 Software Integrations
- 145 Manage
- 141 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 115 Community Announcements
- 4.8K Archive