Use Celery instead of RQ.

Celery provides a more robust set of queueing options for both tasks and
worker processes. Updates include:
- infrastructure necessary to run Celery, including celery entrypoint
- backgrounded functions are now imported directly from atst.jobs
- update tests as-needed
- update kubernetes worker pod command
This commit is contained in:
dandds
2019-08-22 11:55:00 -04:00
parent b7f8152cc1
commit d7478e322a
18 changed files with 209 additions and 191 deletions

View File

@@ -20,12 +20,12 @@ pyopenssl = "*"
requests = "*"
apache-libcloud = "*"
lockfile = "*"
"flask-rq2" = "*"
werkzeug = "*"
PyYAML = "*"
azure-storage = "*"
azure-storage-common = "*"
boto3 = "*"
celery = "*"
[dev-packages]
bandit = "*"