- Hercules, the Hero who saved Prometheus.
- Thomas "Herc" Hauk, meatheaded police officer from The Wire:
herc uses Apache Aurora to schedule jobs running on an Apache Mesos cluster.
The full documentation is in the docs folder; this is just a quick overview.
Herc runs on Python 3.4.
$ git clone git@github.com:broadinstitute/herc.git
$ pyvenv ve_herc
$ source ve_herc/bin/activate
$ python setup.py install
$ screen -mdS herc bash -c 'source ve_herc/bin/activate && herc'
For foreground operation with debug logging to stdout, run herc as: herc --debug
See detailed instructions here
The full list of endpoints provided by herc are always available at:
GET https://localhost:4372/
(4372 is HERC on a phone keypad, if you were wondering.)
At the time of writing, the endpoints are:
GET /Returns a list of endpoints and brief descriptions. This is always accurate; the document you're reading now may not be!GET /schemaReturns the JSON schema used to validate job submissions sent to/submit.POST /submitExpects a JSON body that validates against the schema returned by/schema. Returns a string, the job ID.GET /status/<jobid>Query Aurora and return the status of t 7934 he job id. 404 if not found, otherwise will return JSON with the job's current status and the time it entered that status.GET /sleep/<n>Test endpoint that keeps the connection open for n seconds and then returns how long it was open for.
A deeper dive into the API is available here.
aurora_ip:8081/scheduler
Shows Aurora details about your job. You'll be able to see if it got lost; most often this is because the executor wasn't correctly installed and Mesos gave up on it. In this case you'll see a bunch of failed jobs and an active job that's throttled for "flapping".
mesos_master_ip:5050
Will show you the jobs that Mesos knows about, and allow you dig into the stderr and stdout files generated in the slave sandboxes.