docs.intersystems.com
Using the Work Queue Manager
Using the Work Queue Manager
[Home]  
InterSystems: The power behind what matters   
Search:    

The work queue manager enables you to distribute work to multiple concurrent processes in order to improve performance. InterSystems code uses the work queue manager internally in several places, and you can use it for your own needs as well. This article discusses the following topics:
Also see the class reference for the %SYSTEM.WorkMgr class.
Basics
In order to use this feature, you need to divide the work into units that can be processed independently. Once you have identified such units of work, there are three basic steps:
  1. Initialize the worker jobs. To do this, call the Initialize() method of %SYSTEM.WorkMgr, which returns a work queue — an instance of %SYSTEM.WorkMgr.
    You can specify the number of parallel jobs to use, or you can use the default, which depends on the machine and operating system.
  2. Add work queue items. To do this, call the Queue() method of the work queue. As arguments, pass the name of a class method (or a routine), as well as any arguments.
    When you add a work queue item, the work queue immediately begins work on that item, if possible. If the number of work items is larger than the number of jobs for a work queue, the work queue divides the work items into groups, and processes the groups one at a time. For example, if there are 100 work items and four jobs, the work queue processes the work items four at a time.
    When the work item is run, it uses the security context of the caller.
  3. Wait for the work to be completed. To do this, call the WaitForComplete() method of the work queue.
  4. Continue processing as appropriate for your application.
The following example shows the steps:
    Set queue=##class(%SYSTEM.WorkMgr).Initialize(,.sc) 
    If $$$ISERR(sc) {
       Return sc
    }
    For i = 1:1:filelist.Count() {
        Set sc=queue.Queue("..Load",filelist.GetAt(i))
        If $$$ISERR(sc) { 
            Return sc
        }
    }
    Set sc=queue.WaitForComplete()
    If $$$ISERR(sc) { 
        Return sc
    }
In this example, the code initializes the work queue manager and then iterates through a list of files. For each file, the code adds a work queue item that loads the file. After adding all the work queue items, the code waits for the work to be completed.
Details on the Basic Methods
This section provides reference information on the basic methods shown in the previous section. These methods are available in %SYSTEM.WorkMgr.
Initialize()
classmethod Initialize(qspec As %String = "", ByRef sc As %Status, numberjobs As %Integer) as WorkMgr
Creates, initializes, and returns a work queue, that is, an instance of %SYSTEM.WorkMgr that you can use to perform parallel processing. The arguments are as follows:
You can also specify the number of parallel workers by including the /multicompile=num qualifier within the qspec string, with the following exceptions:
If you specify /multicompile=num and you specify numberjobs, numberjobs takes precedence.
Queue()
method Queue(work As %String, args... As %String) as %Status
Adds a work unit to a work queue. The arguments are as follows:
The security context of the caller is recorded, and each work item runs within that security context.
WaitForComplete()
method WaitForComplete(qspec As %String, errorlog As %String) as %Status
Waits for the work queue to complete all the items and then returns a %Status value to indicate success or failure. The %Status value contains information from all %Status values returned by the work items. The arguments for WorkForComplete() are as follows:
Requirements
The following requirements apply to the units of work that you pass into a work queue:
Including Callbacks for Work Items
You can specify callbacks for work items — code that the work queue manager should execute after completing the work item. To do this, instead of calling the Queue() method, call the QueueCallback() method:
method QueueCallback(work As %String, callback As %String, args... As %String) as %Status
The work and args methods are the same as for the Queue() method.
The callback argument specifies the callback code to execute. For this argument:
The class method or subroutine must accept the same arguments, in the same order, as the main work item. The master process passes the same arguments to the main work item and to the callback code.
The callback code can use the following public variables:
These public variables are available within the callbacks but not within the work items.
Using Callbacks to Determine Completion
The basic technique uses the WaitForComplete() method to wait until all work items are complete. You can instead use callbacks to indicate that work is complete. To do this:
The Wait() method is as follows:
method Wait(qspec As %String, byRef AtEnd As %Boolean) as %Status
This method waits for a signal from a callback to exit back to the caller. Specifically, it waits for the callback code to set the public variable %exit equal to 1. This method returns AtEnd by reference. If AtEnd is 1, all the work is complete. If AtEnd is 0, there are work items that did not get done.
Controlling Output to the Current Device
By default, if work items generate output (WRITE statements) to the current device, the work queue saves the output in a buffer until the end of WaitForComplete() or Wait(). If you want a work item to generate output earlier, have that work item call the Flush() class method of %SYSTEM.WorkMgr.
ClassMethod Flush() as %Status
When the work item calls this method, that causes the parent work queue to write all saved output for the work item.
Also, as usual, you can use the -d flag to suppress all output to the current device. In this case, the Flush() method does nothing, because there is no output.
Pausing and Resuming a Work Queue
The %SYSTEM.WorkMgr class provides methods you can use to pause and resume work within a work queue. These methods do not affect the work items that are currently in progress, but instead affect items that have not yet been started. (For information on halting work completely, including work in progress, see the next section.)
Pause()
method Pause() as %Status
Prevents the work queue processes from accepting additional items from this specific work queue. Any work items currently in progress are completed as usual.
Resume
method Resume() as %Status
Resumes work in this work queue, if it had previously been paused via Pause(). Specifically, this method enables the work queue processes to accept and start additional items in the work queue, if any.
Stopping a Work Queue and Removing Work Items
You can stop a work queue, interrupting any work items in progress and removing any queued work items. To do this, call the Clear() method of the work queue.
method Clear() as %Status
Any work items are immediately stopped. The system removes and then recreates the work queue, with no attached work items. Processing is now considered done, so the system returns immediately from Wait() or WaitForComplete().
Specifying Setup and Teardown Processing
Each work queue typically has multiple worker jobs. If there are more work items than worker jobs, then a worker job will perform multiple work items, one at a time. It is useful to identify any setup steps needed before these work items start, and invoke all such logic before adding the work items to the queue.
The %SYSTEM.WorkMgr class provides methods, Setup() and TearDown(), that you can use to define the setup activity and the cleanup activity for the worker jobs. For example, use Setup() to set public variables for use within the worker job, and use TearDown() to kill those variables. You can also use Setup() to take out locks and to set process-private globals, and you would use TearDown() to release those locks and remove those globals.
In either case, you must call Setup(), TearDown(), or both before calling Queue or QueueCallback. The Setup() and TearDown() methods save information in internal globals used only by the work queue manager. When any worker job starts its first work item from this queue, that worker job first checks the work manager queue globals to see if there is any setup logic. If so, the worker job executes that logic and then starts the work item. The worker job does not execute the setup logic again. Similarly, after any worker job finishes its last work item from the queue, that worker job checks to see if there is any teardown logic. If so, the worker job executes that logic.
The following provides details for these methods:
Setup()
method Setup(work As %String, args... As %String) as %Status
Specifies the code for a worker process to call before processing its first item from the queue. If you use this method, call it before calling Queue or QueueCallback.
The arguments are as follows:
TearDown
method TearDown(work As %String, args... As %String) as %Status
Specifies the code for a worker process to call to restore the process to its previous state, after processing its last item from a queue. If you use this method, call it before calling Queue or QueueCallback.
The arguments are the same as for Setup(), except that work specifies the teardown code to execute.
Notes on the Worker Jobs
The worker jobs are separate processes and can viewed, managed, and monitored like other processes. Note the following points:
If you need to need to know whether a given process is a worker job, call $system.WorkMgr.IsWorkerJob() from within that process (call the IsWorkerJob() method of the class %SYSTEM.WorkMgr).
The work queue (instance of %SYSTEM.WorkMgr) provides the properties NumWorkers (the number of worker jobs assigned to this queue) and NumActiveWorkers (number of currently active worker jobs).


Send us comments on this page
Copyright © 1997-2019 InterSystems Corporation, Cambridge, MA