Skip to content

Commit

Permalink
- not break by instance
Browse files Browse the repository at this point in the history
- fix messages
  • Loading branch information
gabrielcocenza committed Nov 27, 2024
1 parent 0cd67da commit e52dc5d
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions src/alert_rules/prometheus/prometheus_alerts.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,20 +13,20 @@

- "alert": "OpenSearchClusterYellowTemp"
"annotations":
"message": "Cluster {{ $labels.cluster }} health status has been YELLOW for at least 20m. Cluster might be under heavy load."
"message": "Cluster {{ $labels.cluster }} health status has been YELLOW for at least 20m. Shards are still still relocating or initializing. The cluster might be under heavy load."
"summary": "Cluster health status is temporarily YELLOW"
"expr": |
sum by (cluster, instance) (opensearch_cluster_shards_number{type=~"relocating|initializing"}) > 0 and on(cluster, instance) opensearch_cluster_status == 1
sum by (cluster) (opensearch_cluster_shards_number{type=~"relocating|initializing"}) > 0 and on(cluster) opensearch_cluster_status == 1
"for": "20m"
"labels":
"severity": "warning"

- "alert": "OpenSearchClusterYellow"
"annotations":
"message": "Cluster {{ $labels.cluster }} health status has been YELLOW with some replica shards unassigned."
"message": "Cluster {{ $labels.cluster }} health status has been YELLOW. Some replica shards are unassigned."
"summary": "Number of nodes in the cluster might be too low. Consider scaling the application to ensure that it has enough nodes to host all shards."
"expr": |
sum by (cluster, instance) (opensearch_cluster_shards_number{type="unassigned"}) > 0 and on(cluster, instance) opensearch_cluster_status == 1
sum by (cluster) (opensearch_cluster_shards_number{type="unassigned"}) > 0 and on(cluster) opensearch_cluster_status == 1
"for": "10m"
"labels":
"severity": "warning"
Expand Down

0 comments on commit e52dc5d

Please sign in to comment.