Is there any way to find how many times a dataset/dataflow has failed?

ankt84 · 2022-02-17T16:54:48+00:00

There was an error rendering this rich post.

Hello everyone,

I am building a table view card that shows the owner name, dataset/dataflow name, no of times it has failed, and timestamp when it has failed.

I got the first two columns but how do I find the other two columns: Number of failures and Timestamp?

Thanks

Find more posts tagged with

Governance

Comments

GrantSmith

Hi @ankt84

You can find this information using the DomoStats connector and pulling the DataFlow History report. It'll list all the executions for all your data flows so it'll show if it failed and when it failed.

https://domohelp.domo.com/hc/en-us/articles/360043433813-DomoStats-Connector#4.6. has more information on this specific connector and report.

There's also a report for DataSet History as well with that connector.

ankt84

Thanks @GrantSmith

Let me have a look.

GrantSmith

Use an ETL to group it based on the ID and the status and then count the IDs. This will break down your dataset based on the statuses and give you a count. You can filter out then for specific codes

Alternatively if you're using a beast mode you could do a conditional sum:

SUM(CASE WHEN `Status` = 'Failed' THEN 1 ELSE 0 END)

ankt84

That is working fine in case Dataflow but How do I do that in the case of Dataset?

The available status codes in Dataset History are Active, Error, Invalid, Success, and Unknown. How should I define a failed dataset?

Thanks

GrantSmith

It depends on how your company wants to define success but I'd recommend 'Invalid' and 'Success'

SUM(CASE WHEN `Status` IN ('Error', 'Invalid') THEN 1 ELSE 0 END)

Moose

Is there any way to query the "Result" details of a failed dataset so you can see why there was an error running?