Hub

Hub is an orchestration engine written in python and Java.

Intro

Hub accepts 'jobs' which are comprised of one or more 'tasks'.

Jobs are managed by a subsystem of Hub call the 'dispatcher'. The dispatcher breaks up the job into its component tasks and hands them off to 'workers'. Workers handle the task execution and return the associated results to the dispatcher.

Communication between clients and the dispatcher and between the dispatcher and its workers is implemented using message queues and AMQP.