How to optimize datasets in Domo a while importing a huge (30 columns/10 Million rows) database?

Options
AritraChaudhuri
AritraChaudhuri Member
in Archive

How to optimize datasets in Domo a while importing a huge (30 columns/10 Million rows) database from

1. Progress (Openedge Database)

2. Oracle

3. PostgreSQL (ETL)

Comments

  • PEAKS_valleys
    PEAKS_valleys Member
    Options

    Hey @AritraChaudhuri - 

     

    How are you trying to import these datasets?

  • alexpeay
    alexpeay Member
    Options

    @AritraChaudhuri We really need more information. Are you using Workbench to upload the data or are you using direct connections? You mention optimization so I assume that you have a slow down that you are trying to overcome, is that happening on import or is there an issue in some transformation? How often are you uploading this data? Is the data being uploaded using a replace or an append update method?

     

    If we can get more insight into what you are doing and what your end goal is then we can provide better options for optimization.

     

    Thanks for being part of the Dojo.

Categories