How can I connect a csv file that is 1GB in size?

user04829
user04829 Member
in Archive

Hi All,

 

Can anyone let me know how to connect a file with 1 GB size as I am facing an error:

 

"Cant connect file with more than 256 MB size"

 

I  tried  CSV connector and simple file upload but same error.

 

Thanks,

Kumar

Comments

  • AS
    AS Coach

    If you haven't yet, you could try using Domo's Workbench application.  I'm unaware of any size limitations.  Every day we use Workbench to upload a CSV that's over 300MB.

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • user04829
    user04829 Member

    In workbench we used to create jobs if i am not wrong .

    My requirement is to connect with CSV file with 1GB or more size .

    Is this possible?

     

    Regards,

    Kumar

  • AS
    AS Coach

    As far as I know, yes. I've never seen Workbench care about the size of a file. As I mentioned before, one of our large CSVs is placed in an SFTP folder and is uploaded every day by Workbench:

     

    workbench large csv.PNG

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • user04829
    user04829 Member

    Hi,

    My requirement is not to work with workbench.

     

    Thanks,

    Kumar

  • AS
    AS Coach

    That seems like a strange requirement.  I'd push back on that if you can.  If that doesn't work, my next suggestion is to break up the file, load the pieces individually to Domo, and then union them back together with a dataflow or data fusion.

    Aaron
    MajorDomo @ Merit Medical

    **Say "Thanks" by clicking the heart in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"
  • DataMaven
    DataMaven Coach

    The requirement to not use Workbench is sometimes a requirement of the user's company.  I know that our IT department requires us to not use Workbench.  Don't ask about the logic.  It's mostly to hamper our success using Domo and increase our dependence on IT.  

    DataMaven
    Breaking Down Silos - Building Bridges
    **Say "Thanks" by clicking a reaction in the post that helped you.
    **Please mark the post that solves your problem by clicking on "Accept as Solution"

Categories