DataHub supports the starting and pausing of multiple jobs at once. This feature supports filtering the full list of jobs by search criteria or starting / pausing all jobs. The use of this feature via the REST API is described below.
Starting multiple jobs
The syntax for starting and pausing jobs is very similar. The filtering options outlined in the examples apply to both actions.
By default, DataHub will run 6 jobs in parallel. For example, if you start 15 jobs at once, only the first 6 will execute. The rest will be in the queue to start as the others finish
Example 1: Start all jobs
In this scenario, all DataHub jobs will be started.
PATCH
|
|
Example 2: Pause all jobs
In this scenario, all DataHub jobs will be paused.
PATCH
|
|
Example 3: Start jobs using search text to filter the list of jobs
In this scenario, all DataHub jobs with the word "testjob" will be started.
PATCH
|
|
Example 4: Start jobs using an offset and limit to filter the list of jobs
In this scenario, the first five DataHub jobs after the seventh job will be started.
PATCH
|
|
Example 5: Start jobs with a specified parent job
In this scenario, all DataHub jobs with the specified parent job ID will be started.
PATCH
|
|