Does RedShift offer better performance?
I am currently using MySQL data flows and indexing the join fields appropriately but performance seems underwhelming when dealing with millions of rows and/or GB sized data sets. Would I see a performance benefit utilizing RedShift? I began looking into the RedShift documentation and the first difference of note was indexes vs sort key. How do you handle this difference in Domo?
Thank you in advance for your responses.
-----------------
Chris
Best Answer
-
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Answers
-
Is anyone able to help out with this request?
0 -
Hi,
From my experience and if you are handling justifiable amounts of data redshift will offer you a considerable boost in performance.
Actually, all of my 200+ dataflows are exclusively redshift.
I would say that for anything over 250.000 rows go with Redshift (actually I am using it even for fewer quantities of data).
Hope this helps.
Ricardo Granada
**If the post solves your problem, mark it by clicking on "Accept as Solution"
**You can say "Thank you" by clicking the thumbs up in the post that helped you.3 -
We also use Redshift exclusively. Our datasets range from dozens of rows to dozens of millions of rows.
Some benefits for my perspective:
1) No indexing, less maintenance
2) Faster processing on larger datasets
3) Common table expressions, window functions, etc (mysql didn't have this previously, though I've heard that may have changed)
I used to be all about MySQL when I worked for Domo, but that indexing step really bugged me. I don't want that hassle so for me it's a big win to be free of query optimization like that.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Categories
- 10.6K All Categories
- 8 Connect
- 918 Connectors
- 250 Workbench
- 474 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 478 Datasets
- 214 Visualize
- 259 Beast Mode
- 2.1K Charting
- 12 Variables
- 19 Automate
- 356 APIs & Domo Developer
- 89 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 249 Distribute
- 65 Domo Everywhere
- 243 Scheduled Reports
- 21 Manage
- 42 Governance & Security
- 191 Product Ideas
- 1.2K Ideas Exchange
- 11 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive