Dataset not updating.
Can someone help me with this issue?
I'm trying to pull the data from databricks (using python script) into domo dataset.
First I'm trying to create the dataset for a single date using
#domo.ds_create(df2,'datasetname')
then I'm trying to update the same dataset daily. the below code worked till yesterday and its only replacing it from today onwards. not sure what went wrong.
import pandas as pd
import numpy as np
df = spark.sql("Select a, b,c from table a where date > 2023-08-01") — giving a example query
df2 = df.toPandas()
domo.ds_get('datasetid')
Update the Domo datasetdomo.ds_update('datasetid', df_up = df2)
Retrieve dataset from Domodataset_id = 'datasetid'
try:
original_data = domo.ds_get(dataset_id)
except Exception as error:
print(f'Error retrieving dataset: {error}')
# Handle error as needed
...
if original_data.empty:
print('No data retrieved from Domo')
# Handle empty data as needed
...
else:
# Append data to itself
updated_data = original_data.append(original_data).reset_index(drop=True)
# Update dataset in Domo
try:
domo.ds_update(dataset_id, df_up=updated_data)
except Exception as error:
print(f'Error updating dataset: {error}')
# Handle error as needed
Answers
-
Have you validated the data you're getting back from your SQL query? Is it returning all of the data you're expecting?
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Categories
- All Categories
- 1.7K Product Ideas
- 1.7K Ideas Exchange
- 1.5K Connect
- 1.2K Connectors
- 292 Workbench
- 4 Cloud Amplifier
- 8 Federated
- 2.8K Transform
- 95 SQL DataFlows
- 603 Datasets
- 2.1K Magic ETL
- 3.7K Visualize
- 2.4K Charting
- 697 Beast Mode
- 43 App Studio
- 39 Variables
- 658 Automate
- 170 Apps
- 441 APIs & Domo Developer
- 42 Workflows
- 5 DomoAI
- 32 Predict
- 12 Jupyter Workspaces
- 20 R & Python Tiles
- 388 Distribute
- 111 Domo Everywhere
- 271 Scheduled Reports
- 6 Software Integrations
- 113 Manage
- 110 Governance & Security
- 9 Domo University
- 30 Product Releases
- Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 98 Community Announcements
- Domo Community Gallery
- 4.8K Archive