Best Of

Re: Cleaning data off an appending dataset

Hello @user045907 is it possible to replace these datasets instead of appending?

Depending on the window you are looking to populate, and how you are using it, grabbing a window that is x days historical from today is an option in many connectors, but not all.

Which connectors are you using, do they provide a switch for append / replace?

JasonAltenburg

1

Trigger a dataset update via python using a post call

I am currently successfully triggering a dataset update from Snowflake to Domo via python using the following code:

import requests

#list of dataset ids and stream ids for the Snowflake>Domo connections
guids = 
{    'datasetID': 'StreamID',   
 'DatasetID2': 'StreamID2',  
  }


#Does the work of kicking off updates for all Domo datasets linked to Snowflake


domo_token = 'xxxxx'
headers = {'x-domo-developer-token': domo_token}


for i in guids:   
   url = f'https://domain.domo.com/api/data/v1/streams/{guids[i]}/executions'  
    r =     requests.post(url, headers=headers)

The problem is that this is legacy code and so I'm trying to determine how the original developers set this up. I know the dataset ID is in the dataset URL, but I'm not sure how to get a streamID, or set up a stream if necessary that works by executing a snowflake query.

Does anyone know how to set something like the above up where you can trigger the execution of a dataset via the stream api?

For reference, I found some documentation from domo on streams but it's a little too bare to put into action.

left1414

1

Re: Trigger a dataset update via python using a post call

Beat me to it as I was going to suggest pydomo to do this. Here’s more documentation for future users https://github.com/domoinc/domo-python-sdk/blob/master/examples/stream.py

GrantSmith

2

Re: Cleaning data off an appending dataset

You could use the Java CLI tool to do this, but it would likely be a manual approach. I know you want avoid creating an ETL, but creating a simple Magic ETL with a filter tile that looks at the current date and the date field in your dataset would be an easy and dynamic way to filter out the older data.

MarkSnodgrass

2

Cleaning data off an appending dataset

Hi Dojo,

We have several datasets that are appending a decent amount of data each day, and we do not have a need to keep data from as far back as our datasets are holding. Does anyone know of a solution that makes connectors work with a "moving window" to only hold relevant data?

ETL solutions work well for our datasets that use them for recursive update/append, but we also have connector datasets that simply append data onto themselves. There is the option to delete rows individually, but I do not see any good way to clear off chunks of data using any filtering logic.

Does anyone know of a good solution, outside of moving data storage to an ETL output?

Thanks,

Andrew

user045907

1

Have you upgraded Domo SSO successfully (or unsuccessfully) to Azure AD?

We tried to upgrade Domo to Azure AD yesterday. There was an issue getting the AD groups to synch. I was wondering if anyone has been able to successfully get this to work. I’d also be interested in hearing if anyone attempted and it failed. If so, I’d be curious if you were able to figure out how to remove the AD groups with a “1” suffix that were created as part of the upgrade attempt.

Thanks!

PWeed

1

Re: Number Format issues at dashboard/instance level

@Gionniz have you tried reaching out to your AE or CSM to see if there is something they can do? I would also maybe put in a ticket and see if there is any existing solution.

Ashleigh

3