Support for having reusable ETL Logic

DeveshS
Member
We are trying to redesign our existing ETLs (Magic ETL) whereby we want to have two identical sets of ETLs one for Full Load and another for incremental Load. Since the ETL is complex and there are number of ETLS that will adapt same pattern, we would like a functionality in Magic ETL where we can store entire Business Logic have a reusable block and finally use that at multiple ETLs wherever they are required.
OR
Have a common ETL but change input and output datasets dynamically.
Effectively we want to have a Full Load ETL (working every month) and incremental Load will have different frequency of 10-15 mins.
1
Categories
- All Categories
- 1.1K Product Ideas
- 1.1K Ideas Exchange
- 1.2K Connect
- 970 Connectors
- 259 Workbench
- Cloud Amplifier
- 1 Federated
- 2.4K Transform
- 76 SQL DataFlows
- 502 Datasets
- 1.8K Magic ETL
- 2.7K Visualize
- 2.2K Charting
- 379 Beast Mode
- 21 Variables
- 487 Automate
- 104 Apps
- 379 APIs & Domo Developer
- 6 Workflows
- 22 Predict
- 6 Jupyter Workspaces
- 16 R & Python Tiles
- 319 Distribute
- 67 Domo Everywhere
- 252 Scheduled Reports
- 59 Manage
- 59 Governance & Security
- 1 Product Release Questions
- 5K Community Forums
- 37 Getting Started
- 23 Community Member Introductions
- 64 Community Announcements
- 4.8K Archive