Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Page Navigation:

Table of Contents

(blue star) Confidence Level TBD  This article has not been reviewed for accuracy, timeliness, or completeness. Check that this information is valid before acting on it.


What are HySDS Tasks?


Tasks are Celery-level python functions that are dispatched to run in the distributed workers.

Tasks are executed on workers.

Jobs are subclasses of Tasks that add notions of running a subprocess executable in a working directory of a worker.

Tasks have event states as they transition from queued to running and exit conditions.

Task events

...


See http://celery.readthedocs.org/en/latest/userguide/monitoring.html#task-events

task-sent


signature:

task-sent(uuid,name,args,kwargs,retries,eta,expires,queue,exchange,routing_key)


Sent when a task message is published and

...

...

 setting is enabled.

task-received


signature:

task-received(uuid,name,args,kwargs,retries,eta,hostname,timestamp)


Sent when the worker receives a task.

task-started


signature:

task-started(uuid,hostname,timestamp,pid)


Sent just before the worker executes the task.

task-succeeded


signature:

task-succeeded(uuid,result,runtime,hostname,timestamp)


Sent if the task executed successfully.

Runtime is the time it took to execute the task using the pool. (Starting from the task is sent to the worker pool, and ending when the pool result handler callback is called).

task-failed


signature:

task-failed(uuid,exception,traceback,hostname,timestamp)


Sent if the execution of the task failed.

task-revoked


signature:

task-revoked(uuid,terminated,signum,expired)


Sent if the task has been revoked (Note that this is likely to be sent by more than one worker).

  • terminatedis set to true if the task process was terminated,and thesignumfield set to the signal used.

  • expired is set to true if the task expired.

task-retried


signature:

task-retried(uuid,exception,traceback,hostname,timestamp)


Sent if the task failed, but will be retried in the future.

Active task states


are still pending additional activity

  • sent

  • received

  • started

Inactive task states


have no more activity

  • succeeded

  • failed

  • revoked

  • retired

  •  


(lightbulb) Have Questions? Ask a HySDS Developer:

Anyone can join our public Slack channelto learn more about HySDS. JPL employees can join #HySDS-Community

(blue star)

JPLers can also ask HySDS questions atStack Overflow Enterprise

(blue star)

Live Search
placeholderSearch HySDS Wiki