Workflows to check Dataflow executions

Options
JobQuiroz
JobQuiroz Member
in Workflows

Hello.

I've been trying to use the "Get Dataflow Execution Status" and "Was Last DataFlow Run Successful" functions, but I'm getting weird results.

I purposely created a dataflow that always fails:

image.png

Then I test these functions on the workflow editor I get a "FAILURE" and "false" responses (see images).

image.png image.png image.png


However, once I deploy the workflow and run it, the workflow follows the path as if the Dataflow was successful....Am I doing something wrong?

image.png image.png

Answers

  • DanHendriksen
    DanHendriksen Moderator

    Are you saying the status variable was updated by the "Get Dataflow Execution Status" step?

    Can you post a screenshot of what shows up for the inputs and outputs for that step, please?

  • JobQuiroz
    JobQuiroz Member

    On my latest version I'm using the output from "Was Last DataFlow Run Successful":

    image.png

    And yes, it has a "true" value.

  • JobQuiroz
    JobQuiroz Member

    But the other block, "Get DataFlow Execution Status" is also "SUCCESS":

    image.png
  • ssharma
    ssharma Domo Employee

    Hi @JobQuiroz ,

    I'm not 100% sure, but my best guess to what may be happening here is:

    In Workflow Editor (test mode), you're seeing the correct result ("FAILURE" and false). But when it's deployed:

    The workflow may be using cached/stale status, or

    The check runs before the DataFlow has actually finished updating its execution state.

    So when your workflow runs right after triggering a DataFlow, and then checks the execution status immediately after, it might prematurely think it succeeded — simply because the DataFlow status hasn’t updated yet in the backend.

    Again, this is all my guess from what I can see from the images. To get a more accurate explanation on this, you can reach out to domo's support team as they can delve deeper into this and provide you with a more concrete solution.

    Thanks!

  • DanHendriksen
    DanHendriksen Moderator
    https://community-forums.domo.com/main/discussion/comment/101431#Comment_101431

    The API call to the workflow status should return a real time status of the dataflow. The dataflows status isn't cached or stored anywhere…

Categories