Use Celery instead of RQ.

Celery provides a more robust set of queueing options for both tasks and
worker processes. Updates include:
- infrastructure necessary to run Celery, including celery entrypoint
- backgrounded functions are now imported directly from atst.jobs
- update tests as-needed
- update kubernetes worker pod command
This commit is contained in:
dandds
2019-08-22 11:55:00 -04:00
parent b7f8152cc1
commit d7478e322a
18 changed files with 209 additions and 191 deletions

View File

@@ -4,8 +4,10 @@
set -e
WORKER="pipenv run celery -A celery_worker.celery worker --loglevel=info"
if [[ `command -v entr` ]]; then
find atst | entr -r flask rq worker
find atst | entr -r $WORKER
else
flask rq worker
$WORKER
fi