MYSQL Time
Hi,
Is there a way to cut down the time of MYSQL dataflows?
I have a dataflow that takes 6 hours for 5 million rows of data and would love to find a way to cut that down.
Best Answer
-
You can try and implement indexes in your MySQL dataflow however I'd HIGHLY recommend rewriting your MySQL dataflow in Magic ETL as MySQL is sequential (it has to wait for each dataset load or step to complete before it can move to the next one) compared to Magic's sequential processing (can do many steps simultaneously).
I've seen improvements of over 90% when converting MySQL to Magic ETL.
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**1
Answers
-
You can try and implement indexes in your MySQL dataflow however I'd HIGHLY recommend rewriting your MySQL dataflow in Magic ETL as MySQL is sequential (it has to wait for each dataset load or step to complete before it can move to the next one) compared to Magic's sequential processing (can do many steps simultaneously).
I've seen improvements of over 90% when converting MySQL to Magic ETL.
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**1 -
I will give that a try, thank you.
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 302 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 104 SQL DataFlows
- 633 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 760 Beast Mode
- 62 App Studio
- 42 Variables
- 699 Automate
- 181 Apps
- 457 APIs & Domo Developer
- 51 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 401 Distribute
- 116 Domo Everywhere
- 277 Scheduled Reports
- 8 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 111 Community Announcements
- 4.8K Archive