when should we use data fusion over etl data flows
Best Answer
-
Fusion is fantastic for relatively simple joins on large datasets that number in the tens of millions of rows and greater.
The ETL and MySQL dataflows are different ways to accomplish the same end goal, allowing the user to pick the method they are most comfortable with. Some users work best in SQL, so the MySQL ETL recreates that, whereas some people prefer visual drag and drop dataflows which is Magic ETL.
All things being equal, I believe that Magic ETL is slightly more performant than MySQL ETL however.
The choice further comes down to how complicated some of your dataflows are/can be, and how they will be managed. It's easier to see what's happening from a high level with Magic, but can data transformations tricky to perform. MySQL allows for basically any data transformation to occur, but you need to go into each transform to view the logic.
0
Answers
-
Fusion is fantastic for relatively simple joins on large datasets that number in the tens of millions of rows and greater.
The ETL and MySQL dataflows are different ways to accomplish the same end goal, allowing the user to pick the method they are most comfortable with. Some users work best in SQL, so the MySQL ETL recreates that, whereas some people prefer visual drag and drop dataflows which is Magic ETL.
All things being equal, I believe that Magic ETL is slightly more performant than MySQL ETL however.
The choice further comes down to how complicated some of your dataflows are/can be, and how they will be managed. It's easier to see what's happening from a high level with Magic, but can data transformations tricky to perform. MySQL allows for basically any data transformation to occur, but you need to go into each transform to view the logic.
0
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 656 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 813 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 81 App Studio
- 45 Variables
- 773 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 79 Workflows
- 23 Code Engine
- 38 AI and Machine Learning
- 19 AI Chat
- AI Playground
- 1 AI Projects and Models
- 18 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 143 Manage
- 139 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive