Support for having reusable ETL Logic

DeveshS
Member
We are trying to redesign our existing ETLs (Magic ETL) whereby we want to have two identical sets of ETLs one for Full Load and another for incremental Load. Since the ETL is complex and there are number of ETLS that will adapt same pattern, we would like a functionality in Magic ETL where we can store entire Business Logic have a reusable block and finally use that at multiple ETLs wherever they are required.
OR
Have a common ETL but change input and output datasets dynamically.
Effectively we want to have a Full Load ETL (working every month) and incremental Load will have different frequency of 10-15 mins.
1
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 303 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3K Transform
- 105 SQL DataFlows
- 643 Datasets
- 2.2K Magic ETL
- 4K Visualize
- 2.5K Charting
- 771 Beast Mode
- 74 App Studio
- 43 Variables
- 721 Automate
- 185 Apps
- 463 APIs & Domo Developer
- 59 Workflows
- 14 DomoAI
- 40 Predict
- 17 Jupyter Workspaces
- 23 R & Python Tiles
- 402 Distribute
- 116 Domo Everywhere
- 277 Scheduled Reports
- 9 Software Integrations
- 135 Manage
- 132 Governance & Security
- 8 Domo Community Gallery
- 44 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 111 Community Announcements
- 4.8K Archive