From d9671ba9c6ba158cd4516626c4627d38d6478110 Mon Sep 17 00:00:00 2001 From: Paul Buetow Date: Thu, 8 Jan 2026 22:22:10 +0200 Subject: Add special handling for Prometheus Watchdog alert - Treat firing Watchdog as OK status to confirm Alertmanager is working - Treat absent/non-firing Watchdog as CRITICAL to alert on Alertmanager issues - Add comprehensive tests for both scenarios --- report.txt | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+) create mode 100644 report.txt (limited to 'report.txt') diff --git a/report.txt b/report.txt new file mode 100644 index 0000000..ea445f0 --- /dev/null +++ b/report.txt @@ -0,0 +1,27 @@ +GOGIOS Report [C:2 W:2 U:0 S:0 OK:1] + +This is the recent Gogios report! + +# Alerts with status changed: + +UNKNOWN->CRITICAL: Prometheus: KubeProxyDown: KubeProxyDown [critical]: Target disappeared from Prometheus target discovery. +UNKNOWN->CRITICAL: Prometheus: KubeSchedulerDown: KubeSchedulerDown [critical]: Target disappeared from Prometheus target discovery. + +UNKNOWN->WARNING: Prometheus: TargetDown: TargetDown [warning]: One or more targets are unreachable. +UNKNOWN->WARNING: Prometheus: Watchdog: Watchdog [none]: An alert that should always be firing to certify that Alertmanager is working properly. + +UNKNOWN->OK: localhost ping: OK: localhost is alive + +# Unhandled alerts: + +CRITICAL: Prometheus: KubeProxyDown: KubeProxyDown [critical]: Target disappeared from Prometheus target discovery. +CRITICAL: Prometheus: KubeSchedulerDown: KubeSchedulerDown [critical]: Target disappeared from Prometheus target discovery. + +WARNING: Prometheus: TargetDown: TargetDown [warning]: One or more targets are unreachable. +WARNING: Prometheus: Watchdog: Watchdog [none]: An alert that should always be firing to certify that Alertmanager is working properly. + +# Stale alerts: + +There are no stale alerts... + +Have a nice day! -- cgit v1.2.3