New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Look at adding a job state persistence reporting store #1

Closed

camallen opened this issue Jul 1, 2022 · 1 comment

Contributor

camallen commented Jul 1, 2022

Provide job monitoring feature (celery background worker?) to monitor submitted Zoobot batch jobs.

These would track the job state and update as the jobs complete / error.

Also look at adding a polling job status API for requesting this data (via long polling). Similar batch job monitoring code via Azure Cosmos at https://github.com/zooniverse/CameraTraps/blob/master/api/batch_processing/api_core/server_batch_job_manager.py#L127

Contributor Author

camallen commented Nov 9, 2022

we're using the azure batch job resources / API as the job tracking store.

camallen closed this as completed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment