Can I update a dataset on DOMO without having to load the entire dataset?
Right now I have a dataset in DOMO with a certain number of columns. If I append to that dataset using datasets.data_import with a dataframe that has an additional column the data upload is rejected. I want it to accept the import and add an additional column in the dataset in domo
Currently the way I do this is by catching an error when I import data and loading the dataset using domo.ds_get. I concat the domo dataset with the dataset I want to upload with the additional column using pd.concat([domo_dataframe, new_dataframe_with_extra_column]). Then I use domo.ds_update to upload the dataset which updates the schema.
Is there a way to do this where I don't have to load the domo dataset into memory? I want to just provide a dataframe to append to a domo dataset and if the schemas don't match then I want domo to add the additional columns on its end.
Thank you
Answers
-
Hi @OlaBola ,
You can use https://api.domo.com/v1/datasets/{DATASET_ID} end point to get the schema of your existing Domo dataset.
Once you get the schema, compare it with you new dataframe which you are trying to upload, if it does not match, execute the update statement which would reset / update the schema and load the data.
This way, you do not need to store the domo dataset in-memory, and you can still do what is needed.
Thanks
Aditya Jain
'Happy to Help'0
Categories
- 10.5K All Categories
- 3 Connect
- 913 Connectors
- 250 Workbench
- 458 Transform
- 1.7K Magic ETL
- 69 SQL DataFlows
- 476 Datasets
- 183 Visualize
- 249 Beast Mode
- 2.1K Charting
- 11 Variables
- 16 Automate
- 354 APIs & Domo Developer
- 88 Apps
- 3 Workflows
- 20 Predict
- 5 Jupyter Workspaces
- 15 R & Python Tiles
- 245 Distribute
- 62 Domo Everywhere
- 242 Scheduled Reports
- 20 Manage
- 41 Governance & Security
- 168 Product Ideas
- 1.2K Ideas Exchange
- 9 Community Forums
- 27 Getting Started
- 14 Community Member Introductions
- 55 Community News
- 4.5K Archive