Tasks
Page Navigation: |
|---|
Confidence Level TBD This article has not been reviewed for accuracy, timeliness, or completeness. Check that this information is valid before acting on it. |
|---|
What are HySDS Tasks?
Tasks are Celery-level python functions that are dispatched to run in the distributed workers.
Tasks are executed on workers.
Jobs are subclasses of Tasks that add notions of running a subprocess executable in a working directory of a worker.
Tasks have event states as they transition from queued to running and exit conditions.
Task events
See http://celery.readthedocs.org/en/latest/userguide/monitoring.html#task-events
task-sent
signature: | task-sent(uuid,name,args,kwargs,retries,eta,expires,queue,exchange,routing_key) |
|---|
Sent when a task message is published and the CELERY_SEND_TASK_SENT_EVENT setting is enabled.
task-received
signature: | task-received(uuid,name,args,kwargs,retries,eta,hostname,timestamp) |
|---|
Sent when the worker receives a task.
task-started
signature: | task-started(uuid,hostname,timestamp,pid) |
|---|
Sent just before the worker executes the task.
task-succeeded
signature: | task-succeeded(uuid,result,runtime,hostname,timestamp) |
|---|
Sent if the task executed successfully.
Runtime is the time it took to execute the task using the pool. (Starting from the task is sent to the worker pool, and ending when the pool result handler callback is called).
task-failed
signature: | task-failed(uuid,exception,traceback,hostname,timestamp) |
|---|
Sent if the execution of the task failed.
task-revoked¶
signature: | task-revoked(uuid,terminated,signum,expired) |
|---|
Sent if the task has been revoked (Note that this is likely to be sent by more than one worker).
terminatedis set to true if the task process was terminated,and thesignumfield set to the signal used.
expired is set to true if the task expired.
task-retried
signature: | task-retried(uuid,exception,traceback,hostname,timestamp) |
|---|
Sent if the task failed, but will be retried in the future.
Active task states
are still pending additional activity
sent
received
started
Inactive task states
have no more activity
succeeded
failed
revoked
retired
Related Articles: |
|---|
Have Questions? Ask a HySDS Developer: |
Anyone can join our public Slack channel to learn more about HySDS. JPL employees can join #HySDS-Community
|
JPLers can also ask HySDS questions at Stack Overflow Enterprise
|
Page Information: |
|---|
Was this page useful? |
Contribution History:
|
Subject Matter Expert: @Marjorie Lucas @Lan Dang |
Find an Error? Is this document outdated or inaccurate? Please contact the assigned Page Maintainer: @Marjorie Lucas |