Snapshot Dataflow

helpme12345
Member
in Magic ETL
I have a current dataflow that is recursive. I want to make sure the company records that are being snapshotted are.
I am planning to use a field "Snapshot Date" which is the current date timestamp on the recursive.
How would I go about assuring the companies are being snapshotted daily in the ETL? Would I need to match back the final dataflow to the original recursive? Any guidance here would be amazing :)
0
Answers
-
@renee12345 this is actually a great use case for Partitioning in Magic. We current have it in beta. If you would be open to being part of the test. Contact your CSM and we can help.
0 -
Okay.
Any recommendations in the interim?
0
Categories
- All Categories
- Product Ideas
- 2.1K Ideas Exchange
- Connect
- 1.3K Connectors
- 309 Workbench
- 7 Cloud Amplifier
- 10 Federated
- Transform
- 663 Datasets
- 119 SQL DataFlows
- 2.3K Magic ETL
- 823 Beast Mode
- Visualize
- 2.6K Charting
- 86 App Studio
- 46 Variables
- Automate
- 193 Apps
- 483 APIs & Domo Developer
- 86 Workflows
- 23 Code Engine
- AI and Machine Learning
- 23 AI Chat
- 4 AI Projects and Models
- 18 Jupyter Workspaces
- Distribute
- 117 Domo Everywhere
- 283 Scheduled Reports
- 11 Software Integrations
- Manage
- 143 Governance & Security
- 11 Domo Community Gallery
- 49 Product Releases
- 13 Domo University
- Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 116 Community Announcements
- 5K Archive