Workflows to check Dataflow executions

Hello.

I've been trying to use the "Get Dataflow Execution Status" and "Was Last DataFlow Run Successful" functions, but I'm getting weird results.

I purposely created a dataflow that always fails:

image.png

Then I test these functions on the workflow editor I get a "FAILURE" and "false" responses (see images).

image.png image.png image.png


However, once I deploy the workflow and run it, the workflow follows the path as if the Dataflow was successful....Am I doing something wrong?

image.png image.png

Answers

  • DanHendriksen
    DanHendriksen Domo Employee

    Are you saying the status variable was updated by the "Get Dataflow Execution Status" step?

    Can you post a screenshot of what shows up for the inputs and outputs for that step, please?

  • On my latest version I'm using the output from "Was Last DataFlow Run Successful":

    image.png

    And yes, it has a "true" value.

  • But the other block, "Get DataFlow Execution Status" is also "SUCCESS":

    image.png
  • ssharma
    ssharma Domo Employee

    Hi @JobQuiroz ,

    I'm not 100% sure, but my best guess to what may be happening here is:

    In Workflow Editor (test mode), you're seeing the correct result ("FAILURE" and false). But when it's deployed:

    The workflow may be using cached/stale status, or

    The check runs before the DataFlow has actually finished updating its execution state.

    So when your workflow runs right after triggering a DataFlow, and then checks the execution status immediately after, it might prematurely think it succeeded — simply because the DataFlow status hasn’t updated yet in the backend.

    Again, this is all my guess from what I can see from the images. To get a more accurate explanation on this, you can reach out to domo's support team as they can delve deeper into this and provide you with a more concrete solution.

    Thanks!

  • DanHendriksen
    DanHendriksen Domo Employee

    The API call to the workflow status should return a real time status of the dataflow. The dataflows status isn't cached or stored anywhere…