Are Dataflows still only directly driven by dataset updates?

user04906
user04906 Member
edited March 2023 in Datasets

Hi,

 

I have a dataflow which needs to be run daily at a particular hour however the underlying dataset is constant. When I try to set up an automatic schedule this doesn't work unfortunately. However, it works with a manual run.

 

Any help please why is this happening?

 

 

Best Answer

  • cwolman
    cwolman Contributor
    Answer ✓

    Even a scheduled dataset will not run if the underlying data has not changed.  The way I worked around the issue was to create a workbench job that runs daily at 6am which outputs the current date.  My dataflow includes this dataset to kick off the dataflows I want to run at 6am daily.


    -----------------
    Chris

Answers

  • You should be able to go to the Settings tab in your dataflow to make it run on a schedule

     

    Screen Shot 05-13-19 at 10.45 AM.PNG

    Domo Arigato!

    **Say 'Thanks' by clicking the thumbs up in the post that helped you.
    **Please mark the post that solves your problem as 'Accepted Solution'
  • cwolman
    cwolman Contributor
    Answer ✓

    Even a scheduled dataset will not run if the underlying data has not changed.  The way I worked around the issue was to create a workbench job that runs daily at 6am which outputs the current date.  My dataflow includes this dataset to kick off the dataflows I want to run at 6am daily.


    -----------------
    Chris