Joining two datasets in ETL using SQL
Hi,
I am using ETL magic transform sql function.
Input: Dataset
Transform: SQL query let's call it table A
Output: Select * from table A
It is a really simple sql query which should take a maximum of 10 seconds to compute. However, when I save and run the dataflow it is currently on the 10 minute mark.
Any idea why this is happening?
Best Answer
-
The size of the dataset will affect the time it takes to complete. The data needs to be loaded, transformed, and then uploaded and indexed in the presentation layer. Large datasets will take time to go through the process even if the transforms only take seconds.
-----------------
Chris1
Answers
-
The size of the dataset will affect the time it takes to complete. The data needs to be loaded, transformed, and then uploaded and indexed in the presentation layer. Large datasets will take time to go through the process even if the transforms only take seconds.
-----------------
Chris1
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 616 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 738 Beast Mode
- 57 App Studio
- 40 Variables
- 685 Automate
- 176 Apps
- 452 APIs & Domo Developer
- 47 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 124 Manage
- 121 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive