MagicETL Recipes
We all have ETLs where we use common logic over and over again. I propose an idea to enhance MagicETL with something called 'Recipes'. A user could create a new recipe within Magic, add a series of tiles into it that do some common logical steps and save it with a given name (e.g.. 'Strip Whitespace and Split String'. Once saved, you would see your recipe on the tile selection pane in magic. When you drag that recipe onto the MagicETL canvas, all tiles within that recipe are recreated and pre-configured (minus column names etc).
Saving a recipe would tie that recipe to the user who created it so that any new MagicETLs that person creates has those recipes readily available in their tile selection pane. Similar to beast modes, you could then ask for that recipe to be certified. Once certified, any user creating MagicETLs will see those certified recipes.
This would allow organizations to build a library of Magic tips and tricks if you will… and help developers more rapidly work through common logical design patterns when developing ETLs.
Comments
-
That would be nice. At least you can currently use the "Copy to Clipboard" function to pull tiles from one ETL to another.
I have a browser extension called Domo Helper that I will be releasing soon, I could probably make this feature using the copy to clipboard function, I would add a button to below the Copy to Clipboard, called Save Recipe or Save Tile set or something, when clicked it would use the copy to clipboard function, save the copied tile set json data into the extensions local storage and prompt you to give it a name. Then you could click any saved tile set from the extension and it would automatically be inserted into the magic ETL flow.
1 -
This is a cool idea! It would be great for standardizing logic and helping new users get up to speed.
0 -
All right, I got carried away and made this a reality.
If you want to be notified when the extension is available for download in a 1-3 weeks just sign up to be notified on my website:
3 -
@haydentaylor - you're a madman! It's amazing to see an idea come to life so quickly :) Amazing work.
0 -
Thanks! I was looking through your other product ideas since this one was so good. I think I can also make this one into a feature as well. I've been bothered how hard it is to trace back columns in a large ETL to this is a great idea, plus I'll try to pair it with some kind of search, trace function to highlight where a column originates from in any point in the ETL plus anywhere it is modified.
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 623 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 748 Beast Mode
- 60 App Studio
- 41 Variables
- 690 Automate
- 177 Apps
- 455 APIs & Domo Developer
- 48 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 397 Distribute
- 114 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 127 Manage
- 124 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 109 Community Announcements
- 4.8K Archive