Does RedShift offer better performance?
I am currently using MySQL data flows and indexing the join fields appropriately but performance seems underwhelming when dealing with millions of rows and/or GB sized data sets. Would I see a performance benefit utilizing RedShift? I began looking into the RedShift documentation and the first difference of note was indexes vs sort key. How do you handle this difference in Domo?
Thank you in advance for your responses.
-----------------
Chris
Best Answer
-
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Answers
-
Is anyone able to help out with this request?
0 -
Hi,
From my experience and if you are handling justifiable amounts of data redshift will offer you a considerable boost in performance.
Actually, all of my 200+ dataflows are exclusively redshift.
I would say that for anything over 250.000 rows go with Redshift (actually I am using it even for fewer quantities of data).
Hope this helps.
Ricardo Granada
MajorDomo@Lusiaves
**If the post solves your problem, mark it by clicking on "Accept as Solution"
**You can say "Thank you" by clicking the thumbs up in the post that helped you.3 -
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 753 Beast Mode
- 61 App Studio
- 41 Variables
- 692 Automate
- 177 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive