How to change schema of a Dataset created through the Streams API?
Hi,
We have data that we want to visualize in domo, and we are planning on loading it into domo using the Streams API, and then building cards based off that data.
However, we often need to add columns to our data (eg we start collecting a new property on an event). I can't see any way to change the schema of a data set in the Streams API. By contrast, with datasets created in the GUI, it accepts schema changes without any problem.
Can anyone help? Am I overlooking something?
Thanks!
Comments
-
Could someone help with this issue?
0 -
I've used the Update DataSet MetaData method. But if I remember correctly, I had to delete all my rows first (things may have changed now since I haven't done this in a while). I was unhappy that I had to delete all my data rows, but at least I was able to continue streaming to the same dataset without creating a new one.
0 -
We are having the same issue.
If the schema changes on a api cloud app, everything else downstream seems to break.How do we modify the data source to adjust the schema? Or do we need to recreate the data source and then migrate all of the cards?I have scoured the training material and haven’t found the solution yet...0 -
So I'm still trying to find an answer to this issues. The closest thing I could find is this: Python Example
# Update a DataSets's metadata
update = DataSetRequest()
update.name = 'Leonhard Euler Party - Update'
update.description = 'Mathematician Guest List - Update'
update.schema = Schema([Column(ColumnType.STRING, 'Friend'),
Column(ColumnType.STRING, 'Attending')])
updated_dataset = datasets.update(dataset['id'], update)
domo.logger.info("Updated DataSet {}: {}".format(updated_dataset['id'],
updated_dataset['name']))It seems that you can add an update.schema value to this and it will be picked up by the API and add those fields to your Schema. I'm currently working with support to verify this and determine how to properly construct the fields, but this gives the best hints I've found so far.
2 -
Any update on this and the best practices to follow?
0
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 297 Workbench
- 6 Cloud Amplifier
- 8 Federated
- 2.9K Transform
- 100 SQL DataFlows
- 614 Datasets
- 2.2K Magic ETL
- 3.8K Visualize
- 2.5K Charting
- 729 Beast Mode
- 53 App Studio
- 40 Variables
- 677 Automate
- 173 Apps
- 451 APIs & Domo Developer
- 45 Workflows
- 8 DomoAI
- 34 Predict
- 14 Jupyter Workspaces
- 20 R & Python Tiles
- 394 Distribute
- 113 Domo Everywhere
- 275 Scheduled Reports
- 6 Software Integrations
- 121 Manage
- 118 Governance & Security
- Domo Community Gallery
- 32 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 108 Community Announcements
- 4.8K Archive