How can I connect a csv file that is 4 GB in size?
Hello,
I have a very large (4 GB) csv file that I'd like to bring in to Domo but it exceeds all the size limits that I've tried. What would be the best way to accomplish this?
Best Answer
-
What methods have you tried that you're having trouble with?
Generally speaking, Domo doesn't care much how large files are. While you might not be able to open that file in a textpad or Excel type application, Domo should be able to grab that file either from Workbench or through the CSV connector.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Answers
-
What methods have you tried that you're having trouble with?
Generally speaking, Domo doesn't care much how large files are. While you might not be able to open that file in a textpad or Excel type application, Domo should be able to grab that file either from Workbench or through the CSV connector.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2 -
Thanks Aaron!
I had initially tried workbench and it gave me a vauge error so I took it to mean that the file was too large. It turns out that the headers in the file were not properly formated - there were a few blanks and duplicates. After fixing the headers to be unique it took about 10 minutes but workbenched uploaded the file without any problems.
Thanks again for help!
1 -
As an additional note to this - Something annoying I have found. The newer file uploader has a size limitation. I don't recall the exact size, but it was pretty small.
DataMaven
Breaking Down Silos - Building Bridges
**Say "Thanks" by clicking a reaction in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"1
Categories
- All Categories
- 1.9K Product Ideas
- 1.9K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 302 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 104 SQL DataFlows
- 637 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 762 Beast Mode
- 65 App Studio
- 42 Variables
- 705 Automate
- 182 Apps
- 459 APIs & Domo Developer
- 53 Workflows
- 11 DomoAI
- 39 Predict
- 16 Jupyter Workspaces
- 23 R & Python Tiles
- 401 Distribute
- 116 Domo Everywhere
- 277 Scheduled Reports
- 8 Software Integrations
- 133 Manage
- 130 Governance & Security
- 8 Domo Community Gallery
- 43 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 111 Community Announcements
- 4.8K Archive