How can I connect a csv file that is 4 GB in size?

Hello,
I have a very large (4 GB) csv file that I'd like to bring in to Domo but it exceeds all the size limits that I've tried. What would be the best way to accomplish this?
Best Answer
-
What methods have you tried that you're having trouble with?
Generally speaking, Domo doesn't care much how large files are. While you might not be able to open that file in a textpad or Excel type application, Domo should be able to grab that file either from Workbench or through the CSV connector.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2
Answers
-
What methods have you tried that you're having trouble with?
Generally speaking, Domo doesn't care much how large files are. While you might not be able to open that file in a textpad or Excel type application, Domo should be able to grab that file either from Workbench or through the CSV connector.
Aaron
MajorDomo @ Merit Medical
**Say "Thanks" by clicking the heart in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"2 -
Thanks Aaron!
I had initially tried workbench and it gave me a vauge error so I took it to mean that the file was too large. It turns out that the headers in the file were not properly formated - there were a few blanks and duplicates. After fixing the headers to be unique it took about 10 minutes but workbenched uploaded the file without any problems.
Thanks again for help!
1 -
As an additional note to this - Something annoying I have found. The newer file uploader has a size limitation. I don't recall the exact size, but it was pretty small.
DataMaven
Breaking Down Silos - Building Bridges
**Say "Thanks" by clicking a reaction in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"1
Categories
- All Categories
- 2K Product Ideas
- 2K Ideas Exchange
- 1.6K Connect
- 1.3K Connectors
- 311 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 3.8K Transform
- 657 Datasets
- 115 SQL DataFlows
- 2.2K Magic ETL
- 815 Beast Mode
- 3.3K Visualize
- 2.5K Charting
- 81 App Studio
- 45 Variables
- 775 Automate
- 190 Apps
- 481 APIs & Domo Developer
- 81 Workflows
- 23 Code Engine
- 40 AI and Machine Learning
- 20 AI Chat
- 1 AI Playground
- 1 AI Projects and Models
- 18 Jupyter Workspaces
- 410 Distribute
- 120 Domo Everywhere
- 280 Scheduled Reports
- 10 Software Integrations
- 144 Manage
- 140 Governance & Security
- 8 Domo Community Gallery
- 48 Product Releases
- 12 Domo University
- 5.4K Community Forums
- 41 Getting Started
- 31 Community Member Introductions
- 114 Community Announcements
- 4.8K Archive