Does RedShift offer better performance?
I am currently using MySQL data flows and indexing the join fields appropriately but performance seems underwhelming when dealing with millions of rows and/or GB sized data sets. Would I see a performance benefit utilizing RedShift? I began looking into the RedShift documentation and the first difference of note was indexes vs sort key. How do you handle this difference in Domo?
Thank you in advance for your responses.
-----------------
Chris
Best Answer
-
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Answers
-
Is anyone able to help out with this request?
0 -
Hi,
From my experience and if you are handling justifiable amounts of data redshift will offer you a considerable boost in performance.
Actually, all of my 200+ dataflows are exclusively redshift.
I would say that for anything over 250.000 rows go with Redshift (actually I am using it even for fewer quantities of data).
Hope this helps.
Ricardo Granada
MajorDomo@Lusiaves
**If the post solves your problem, mark it by clicking on "Accept as Solution"
**You can say "Thank you" by clicking the thumbs up in the post that helped you.3 -
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 292 Workbench
- 4 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 95 SQL DataFlows
- 602 Datasets
- 2.1K Magic ETL
- 3.7K Visualize
- 2.4K Charting
- 691 Beast Mode
- 43 App Studio
- 39 Variables
- 658 Automate
- 170 Apps
- 441 APIs & Domo Developer
- 42 Workflows
- 5 DomoAI
- 32 Predict
- 12 Jupyter Workspaces
- 20 R & Python Tiles
- 386 Distribute
- 111 Domo Everywhere
- 269 Scheduled Reports
- 6 Software Integrations
- 112 Manage
- 109 Governance & Security
- 8 Domo University
- 30 Product Releases
- Community Forums
- 39 Getting Started
- 29 Community Member Introductions
- 98 Community Announcements
- Domo Community Gallery
- 4.8K Archive