Skip to content

Commit

Permalink
Remove buggy or vector(0) from alerts (#29)
Browse files Browse the repository at this point in the history
They were causing false positives.
  • Loading branch information
douglascamata authored Sep 22, 2023
1 parent 1df7a85 commit c3b6062
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 6 deletions.
6 changes: 3 additions & 3 deletions jsonnet/lib/alerts.libsonnet
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
sum_over_time(obsctl_reloader_prom_rules_store_ops_total{status_code=~"5..|4..", %(obsctlReloaderSelector)s}[5m])
/
sum(sum_over_time(obsctl_reloader_prom_rules_store_ops_total{%(obsctlReloaderSelector)s}[5m]))
) or vector(0)
)
> 0.10
||| % $._config,
'for': '10m',
Expand All @@ -30,7 +30,7 @@
sum_over_time(obsctl_reloader_prom_rule_set_failures_total{reason!="rules_store_error", %(obsctlReloaderSelector)s}[5m])
/
sum_over_time(obsctl_reloader_prom_rule_set_total{%(obsctlReloaderSelector)s}[5m])
) or vector(0)
)
> 0.10
||| % $._config,
'for': '10m',
Expand All @@ -49,7 +49,7 @@
sum_over_time(obsctl_reloader_prom_rule_fetch_failures_total{%(obsctlReloaderSelector)s}[5m])
/
sum_over_time(obsctl_reloader_prom_rule_fetches_total{%(obsctlReloaderSelector)s}[5m])
) or vector(0)
)
> 0.20
||| % $._config,
'for': '5m',
Expand Down
6 changes: 3 additions & 3 deletions openshift/alerts.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ groups:
sum_over_time(obsctl_reloader_prom_rules_store_ops_total{status_code=~"5..|4..", job="obsctl-reloader"}[5m])
/
sum(sum_over_time(obsctl_reloader_prom_rules_store_ops_total{job="obsctl-reloader"}[5m]))
) or vector(0)
)
> 0.10
for: 10m
labels:
Expand All @@ -24,7 +24,7 @@ groups:
sum_over_time(obsctl_reloader_prom_rule_set_failures_total{reason!="rules_store_error", job="obsctl-reloader"}[5m])
/
sum_over_time(obsctl_reloader_prom_rule_set_total{job="obsctl-reloader"}[5m])
) or vector(0)
)
> 0.10
for: 10m
labels:
Expand All @@ -38,7 +38,7 @@ groups:
sum_over_time(obsctl_reloader_prom_rule_fetch_failures_total{job="obsctl-reloader"}[5m])
/
sum_over_time(obsctl_reloader_prom_rule_fetches_total{job="obsctl-reloader"}[5m])
) or vector(0)
)
> 0.20
for: 5m
labels:
Expand Down

0 comments on commit c3b6062

Please sign in to comment.