How to optimize datasets in Domo a while importing a huge (30 columns/10 Million rows) database?

How to optimize datasets in Domo a while importing a huge (30 columns/10 Million rows) database from

1. Progress (Openedge Database)

2. Oracle

3. PostgreSQL (ETL)

Comments

  • Hey @AritraChaudhuri - 

     

    How are you trying to import these datasets?

  • alexpeay
    alexpeay Domo Employee

    @AritraChaudhuri We really need more information. Are you using Workbench to upload the data or are you using direct connections? You mention optimization so I assume that you have a slow down that you are trying to overcome, is that happening on import or is there an issue in some transformation? How often are you uploading this data? Is the data being uploaded using a replace or an append update method?

     

    If we can get more insight into what you are doing and what your end goal is then we can provide better options for optimization.

     

    Thanks for being part of the Dojo.

    Alex Peay
    Product Manager
    Domo