Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add detection of flapping alerts #145

Closed
err404r opened this issue Jul 5, 2024 · 2 comments · May be fixed by #148
Closed

Add detection of flapping alerts #145

err404r opened this issue Jul 5, 2024 · 2 comments · May be fixed by #148
Labels
Status: Triage Type: Enhancement

Comments

@err404r
Copy link

err404r commented Jul 5, 2024

Enhancement Proposal

It would by nice to have a separate rule to alert when we have a flapping alerts
@err404r
Copy link
Author

err404r commented Jul 5, 2024

Something like changes(ALERTS_FOR_STATE{severity = "warning"}[1h]) > 5 It's mostly important for warnings, because they could be missed

@simskij simskij mentioned this issue Jul 9, 2024
Open
@err404r err404r closed this as completed Sep 13, 2024
@err404r
Copy link
Author

err404r commented Sep 13, 2024

Inhibition alert are not working that way, so we can't use flapping alert to properly suppress flapping alerts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Status: Triage Type: Enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

feat(alerting): detect flapping alerts canonical/grafana-agent-operator
1 participant
@err404r