Can I update a dataset on DOMO without having to load the entire dataset?
Right now I have a dataset in DOMO with a certain number of columns. If I append to that dataset using datasets.data_import with a dataframe that has an additional column the data upload is rejected. I want it to accept the import and add an additional column in the dataset in domo
Currently the way I do this is by catching an error when I import data and loading the dataset using domo.ds_get. I concat the domo dataset with the dataset I want to upload with the additional column using pd.concat([domo_dataframe, new_dataframe_with_extra_column]). Then I use domo.ds_update to upload the dataset which updates the schema.
Is there a way to do this where I don't have to load the domo dataset into memory? I want to just provide a dataframe to append to a domo dataset and if the schemas don't match then I want domo to add the additional columns on its end.
Thank you
Answers
-
Hi @OlaBola ,
You can use https://api.domo.com/v1/datasets/{DATASET_ID} end point to get the schema of your existing Domo dataset.
Once you get the schema, compare it with you new dataframe which you are trying to upload, if it does not match, execute the update statement which would reset / update the schema and load the data.
This way, you do not need to store the domo dataset in-memory, and you can still do what is needed.
Thanks
Aditya Jain
'Happy to Help'0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 294 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 97 SQL DataFlows
- 607 Datasets
- 2.1K Magic ETL
- 3.8K Visualize
- 2.4K Charting
- 707 Beast Mode
- 49 App Studio
- 39 Variables
- 667 Automate
- 170 Apps
- 446 APIs & Domo Developer
- 44 Workflows
- 7 DomoAI
- 33 Predict
- 13 Jupyter Workspaces
- 20 R & Python Tiles
- 391 Distribute
- 111 Domo Everywhere
- 274 Scheduled Reports
- 6 Software Integrations
- 115 Manage
- 112 Governance & Security
- Domo Community Gallery
- 31 Product Releases
- 9 Domo University
- 5.3K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 103 Community Announcements
- 4.8K Archive