Alerting
Notification channels
- Slack / Teams / Discord
- PagerDuty / OpsGenie
- Email (SMTP)
- Webhook (generic)
Sample rule
alert: HighRequestLatency
expr: histogram_quantile(0.95, rate(http_request_duration_seconds_bucket[5m])) > 0.5
for: 10m
labels:
severity: warning
annotations:
summary: "p95 latency above 500ms"