How to reduce SQL Dataflow runtime?
Best Answer
-
If you're using transforms in multiple stages, you can create new transforms, without outputs, and create indexes in them, like:
alter table `transform_data_1` add index (`column_name1`,`column_name2`)
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"3
Answers
-
What have you currently implemented?
The first option is to ensure you're properly indexing your inputs as well as your transforms.
A second option would be to reduce the number of columns your inputs and transforms have.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"0 -
I am joining 3 different tables and performing calculations on the 3 columns in the 3 different datasets.
I have indexed columns which are involved in the join.
How to index on the transforms?
0 -
If you're using transforms in multiple stages, you can create new transforms, without outputs, and create indexes in them, like:
alter table `transform_data_1` add index (`column_name1`,`column_name2`)
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"3
Categories
- All Categories
- Product Ideas
- 2.1K Ideas Exchange
- Data Connections
- 1.3K Connectors
- 309 Workbench
- 17 Cloud Integrations
- Data & ETL
- 2.3K Magic ETL
- 120 SQL DataFlows
- 667 Datasets
- Visualize & Apps
- 90 App Studio
- 198 Pro-code Components
- 2.6K Charting & Analyzer
- 873 Calculations & Variables (Beast Mode)
- AI & Data science
- 23 Domo AI & AI Chat
- 4 Managing AI
- 18 Jupyter Workspaces
- Automate
- 122 Workflows
- Alerts
- Distribute
- 118 Domo Everywhere
- 284 Reporting
- Manage
- 146 Governance & Security
- 489 APIs
- 11 Add-ins & Plugins
- 13 Domo Community Gallery
- 49 Product Releases
- 13 Domo University
- Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 118 Community Announcements
- 5K Archive