Redshift Upsert Size Limitations
Hi,
Does anyone know of any known size limitations with the Redshift Upsert Connector? I have a dataset that has roughly 125 columns and 18Mil records. We would like to drastically reduce the amount of time this takes to run by only updating the most recent 6 months (nearly 4 million rows), however, DOMO throws the below error in doing so.
"Out of memory: Try a smaller fetch size."
Comments
-
Hi,
There are no specific limits Domo are listing in the documentation here;
However, Amazon does list many limits in this documentation;
https://docs.aws.amazon.com/redshift/latest/mgmt/amazon-redshift-limits.html
Although nothing is Listed for "Out of memory: Try a smaller fetch size" does your error give any indication of if this is in Domo or Amazon the error is happening? Screenshots may help if you can upload them, or Domo Support may be able to help answer that question.
Jarvis
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 753 Beast Mode
- 61 App Studio
- 41 Variables
- 692 Automate
- 177 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive