Support for having reusable ETL Logic
DeveshS
Member
We are trying to redesign our existing ETLs (Magic ETL) whereby we want to have two identical sets of ETLs one for Full Load and another for incremental Load. Since the ETL is complex and there are number of ETLS that will adapt same pattern, we would like a functionality in Magic ETL where we can store entire Business Logic have a reusable block and finally use that at multiple ETLs wherever they are required.
OR
Have a common ETL but change input and output datasets dynamically.
Effectively we want to have a Full Load ETL (working every month) and incremental Load will have different frequency of 10-15 mins.
1
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 299 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 616 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 54 App Studio
- 40 Variables
- 681 Automate
- 175 Apps
- 451 APIs & Domo Developer
- 46 Workflows
- 9 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 33 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive