Dataset API - Getting full dataset list
I'm currently using requests in python to pull in a list of all datasets, however I'm only receving 50 as the max limit and there are >200 total sets. Additionally, about 95% of returned results are created by "DomoBIB" which isn't even part of the dataset that was created by me.
dataset_endpoint = "https://api.domo.com/v1/datasets"
dataset_response = requests.get(dataset_endpoint, headers={'Authorization': token})
Is there a way to increase the return size so that it actually does return a list of all datasets? Editing the limit parameter gives an error that the number has to be positive and under 50. Additionally, is it possible to filter out all "DomoBIB" sets?
Comments
-
Have you tried messing with offset or sort?
sortSTRINGSort the list of DataSets by propertyPOSSIBLE VALUES:name, description, owner.id, owner.nameoffsetSTRINGPaginate the list of DataSets
**Make sure to like any users posts that helped you and accept the ones who solved your issue.**0 -
I've messed around with both parameters, only sort gives me any sort of different output but is still not the full list of all datasets. There's datasets from multiple users and I want to grab all of them, except for the auto-generated ones from "DomoBIB".
Not really sure what offset does but there's no difference in response with different offset parameters.
0 -
Hi,
I have started working with the DataSet API as well. I our case we are using the end point to list data sets to look for data sets with a specific prefix in their name. The current end point (https://api.domo.com/v1/datasets) is inefficient to do this as it needs to be called many times to iterate through all of the data sets (sort, limit and offset are of little help). It would be useful to be able to filter the list of data sets by a prefix of the data set name (similar to the AWS S3 API).
It would also be helpful if sorting would work on the "dataCurrentAt" or "updatedAt" time stamps. Currently I get an error when trying to sort anything other than "name".
regards
Andreas
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 102 SQL DataFlows
- 626 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 753 Beast Mode
- 61 App Studio
- 41 Variables
- 692 Automate
- 177 Apps
- 456 APIs & Domo Developer
- 49 Workflows
- 10 DomoAI
- 38 Predict
- 16 Jupyter Workspaces
- 22 R & Python Tiles
- 398 Distribute
- 115 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 130 Manage
- 127 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 11 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 110 Community Announcements
- 4.8K Archive