Workbench Scheduler to Batch Run Jobs
First some background...there are 6 Jobs that I need to run in Workbench every day. The source data becomes available at different times and I need to manually format the sorce files for all 6 before upload, so I can't set a daily time schedule to automatically upload. The last of the 6 uploads triggers an ETL to run, so although that Job needs to run last, the order of the rest is arbitrary. Currently it's a big waste of time and effort to manually run a Job, wait for it to finish, then run the next.
My question is - is there a way for me to set a Schedule or Schedules in workbench so that I can manually run the first Job, then use the completion of that Job to trigger the next Job, and so on untill all 6 Jobs are run?
Thanks!
Best Answer
-
The Workbench DataSet Job Group Wizard (Tools->Schedule) will generate a batch file as part of the schedualling process.
The batch file rusn the selected jobs in sequence which is what you need.
So create a schedule wiht the jobs you need. Go to Task scheduler, disable the task and check where the batch file is located.
Modify the batch file to make sure that the ETL trigger jobs runs always last.
Executing the batch file will then trigger each job, one after the other.
2
Answers
-
I don't know of a Workbench solution so I'll ask a different question. How intensive is the manipulation? Is it the same repeatable step (Ex. Report comes over with the top row being blank and some totals and you remove them) or does it differ everyday? What's the high level task you have to manually do?
**Make sure to like any users posts that helped you and accept the ones who solved your issue.**0 -
Hi, thanks for your reply. The manual manipulation is minimal. Waiting for each upload to complete so I can start the next is a larger time waste than setting up the input files.
0 -
The Workbench DataSet Job Group Wizard (Tools->Schedule) will generate a batch file as part of the schedualling process.
The batch file rusn the selected jobs in sequence which is what you need.
So create a schedule wiht the jobs you need. Go to Task scheduler, disable the task and check where the batch file is located.
Modify the batch file to make sure that the ETL trigger jobs runs always last.
Executing the batch file will then trigger each job, one after the other.
2 -
Nice! Didn't know that, has that been around for a while?
**Make sure to like any users posts that helped you and accept the ones who solved your issue.**0 -
This worked beautifully, thank you for your help!
0 -
Here is the step-by-step process for anyone else who may have a need to batch-run Jobs in a specific order.
- In Workbench, make note of the Job Number for the Job that must run last
- Expand the Job
- Click Logs, and choose the last date on which the job ran
- Look for [job:XXXX] where XXXX = Job number
- Create a new Schedule
- Click on Tools, Schedule
- New Scheduled Group, Next
- Enter a name, check off included DataSet Jobs, Next
- Modify Schedule (this opens the Windows Task Scheduler)
- Expand “Task Scheduler Library” folder
- Click on the DomoV4 (or current version) folder
- To allow manual-only running of the batch, click on new scheduled task, in the right pane click “ê Disable” under “Selected Item”
- Edit Batch File
- In the same window, click “Properties” under “Selected Item”, new window pops up
- Go to the “Actions” tab, make note of the file location in “Details” (clicking on “Edit…” allows you to copy the path), which should look similar to this: C:\ProgramData\Domo\Workbench\Groups\
- Also make note of the name of the batch file, which should be a long string of characters ending in “.bat”
- Open Windows Explorer and navigate to that path
- Right-Click on the batch file and choose “Edit”
- Find the Job that triggers the ETL run (the file that must be uploaded last) and move that Job’s line to the end of the list.
- Execute Batch File: Double-click batch file to run manually, this will complete all specified Jobs in the specified order.
4 - In Workbench, make note of the Job Number for the Job that must run last
Categories
- All Categories
- 1.8K Product Ideas
- 1.8K Ideas Exchange
- 1.6K Connect
- 1.2K Connectors
- 300 Workbench
- 6 Cloud Amplifier
- 9 Federated
- 2.9K Transform
- 101 SQL DataFlows
- 622 Datasets
- 2.2K Magic ETL
- 3.9K Visualize
- 2.5K Charting
- 748 Beast Mode
- 60 App Studio
- 41 Variables
- 689 Automate
- 177 Apps
- 454 APIs & Domo Developer
- 48 Workflows
- 10 DomoAI
- 36 Predict
- 15 Jupyter Workspaces
- 21 R & Python Tiles
- 397 Distribute
- 114 Domo Everywhere
- 276 Scheduled Reports
- 7 Software Integrations
- 127 Manage
- 124 Governance & Security
- 8 Domo Community Gallery
- 38 Product Releases
- 10 Domo University
- 5.4K Community Forums
- 40 Getting Started
- 30 Community Member Introductions
- 109 Community Announcements
- 4.8K Archive