Is there a way to update/run a dataset or ETL every 1 minute?

I know…it sounds crazy, but I have a client that wants to run an ETL every minute. Here is what we have explored to no avail:

  1. Advanced schedule on a dataset and on the ETL
  2. Workbench
  3. Using scheduled reports to trigger an email connector

Issue is that those increments are only 15 minutes and we can't specify down to the minute or to say we need more frequency. One other option I'm thinking is to create a webhook because whenever that fires, it would trigger an update which then could trigger the ETL.

Looking for any help and creative ideas.

John Le

Let me make you the me of your organization for Domo

Click here for more video solutions: https://www.dashboarddudes.com/pantry

Best Answer

  • Tasleema
    Tasleema Domo Product Manager
    Answer ✓

    @dashboardDude - You can ask your CSM or AE to put in a request to increase the refresh rate on a dataset by dataset basis, as long as the dataset is not an output of an ETL. You can then use that as a trigger to run the ETL.

Answers

  • I was told this is possible by my CSM or AE I can't remember which one. But it would require working with Domo to enable for the instance/dataset.

    If I solved your problem, please select "yes" above

  • Oh I remember it was @Tasleema who said this could be done.

    If I solved your problem, please select "yes" above

  • I have heard that you can put it in a request to support to get it configured to 1 minute. The other workarounds I have heard are using webhooks or workflows to kick it off.

    **Check out my Domo Tips & Tricks Videos

    **Make sure to <3 any users posts that helped you.
    **Please mark as accepted the ones who solved your issue.
  • @Elliott_Leonard also suggested a workflow as an option.

    So possible solutions so far:

    1. Work with Domo directly
    2. Workflow
    3. Webhook
    4. WWE (World Wrestling Entertainment/Federation)

    John Le

    Let me make you the me of your organization for Domo

    Click here for more video solutions: https://www.dashboarddudes.com/pantry

  • Tasleema
    Tasleema Domo Product Manager
    Answer ✓

    @dashboardDude - You can ask your CSM or AE to put in a request to increase the refresh rate on a dataset by dataset basis, as long as the dataset is not an output of an ETL. You can then use that as a trigger to run the ETL.

  • Thank you @Tasleema and @Elliott_Leonard. Plan A is to ask Domo to allow for the 1 min frequency and plan B is the workflow email send. I just did it and it's working great as a solution.

    John Le

    Let me make you the me of your organization for Domo

    Click here for more video solutions: https://www.dashboarddudes.com/pantry

  • @DashboardDude option 1 seems like the way to go for a couple of reasons:
    1. Least complexity/effort
    2. Least credit implications
    3. Was the idea I suggested so I would get the accepted answer :D

    If I solved your problem, please select "yes" above

  • @ColemenWilson can't share the praise with @Tasleema or @ellibot!

    "You're either first or last"- Colemen/ Ricky Bobby

    John Le

    Let me make you the me of your organization for Domo

    Click here for more video solutions: https://www.dashboarddudes.com/pantry

  • The stakes are high. I'm trying to win some Domo branded keychains.

    If I solved your problem, please select "yes" above