New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create Cloudwatch alert if scheduler is broken #350

Open

maxneuvians opened this issue Dec 18, 2023 · 1 comment · Fixed by #658

Assignees

Contributor

maxneuvians commented Dec 18, 2023

We have a scheduler that create a log every 5 minutes to make sure that it is still alive.

https://github.com/cds-snc/sre-bot/blob/main/app/jobs/scheduled_tasks.py#L19-L23

We should create an alert that makes sure this shows up every 5 minutes, otherwise it is probably dead.

sylviamclaughlin self-assigned this

gcharest mentioned this issue

feat: setup an alarm when no log within 5 mins #658

Merged

gcharest closed this as completed in #658

gcharest reopened this

Contributor

gcharest commented Sep 20, 2024

Reverted the change as the current pricing model of the cloudwatch alarm would be about 1k per month... 😅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment