Dataset not updating.
Can someone help me with this issue?
I'm trying to pull the data from databricks (using python script) into domo dataset.
First I'm trying to create the dataset for a single date using
#domo.ds_create(df2,'datasetname')
then I'm trying to update the same dataset daily. the below code worked till yesterday and its only replacing it from today onwards. not sure what went wrong.
import pandas as pd
import numpy as np
df = spark.sql("Select a, b,c from table a where date > 2023-08-01") — giving a example query
df2 = df.toPandas()
domo.ds_get('datasetid')
Update the Domo datasetdomo.ds_update('datasetid', df_up = df2)
Retrieve dataset from Domodataset_id = 'datasetid'
try:
original_data = domo.ds_get(dataset_id)
except Exception as error:
print(f'Error retrieving dataset: {error}')
# Handle error as needed
...
if original_data.empty:
print('No data retrieved from Domo')
# Handle empty data as needed
...
else:
# Append data to itself
updated_data = original_data.append(original_data).reset_index(drop=True)
# Update dataset in Domo
try:
domo.ds_update(dataset_id, df_up=updated_data)
except Exception as error:
print(f'Error updating dataset: {error}')
# Handle error as needed
Answers
-
Have you validated the data you're getting back from your SQL query? Is it returning all of the data you're expecting?
**Was this post helpful? Click Agree or Like below**
**Did this solve your problem? Accept it as a solution!**0
Categories
- All Categories
- 1.2K Product Ideas
- 1.2K Ideas Exchange
- 1.4K Connect
- 1.1K Connectors
- 273 Workbench
- 2 Cloud Amplifier
- 3 Federated
- 2.7K Transform
- 78 SQL DataFlows
- 525 Datasets
- 2.1K Magic ETL
- 2.9K Visualize
- 2.2K Charting
- 437 Beast Mode
- 23 Variables
- 513 Automate
- 115 Apps
- 390 APIs & Domo Developer
- 8 Workflows
- 26 Predict
- 10 Jupyter Workspaces
- 16 R & Python Tiles
- 332 Distribute
- 77 Domo Everywhere
- 255 Scheduled Reports
- 66 Manage
- 66 Governance & Security
- 1 Product Release Questions
- Community Forums
- 40 Getting Started
- 26 Community Member Introductions
- 68 Community Announcements
- 4.8K Archive