Differences

This shows you the differences between two versions of the page.

--- resolution_area:prometheus_resolutions:res-p1111 [2021/06/25 10:09] – external edit 127.0.0.1
+++ resolution_area:prometheus_resolutions:res-p1111 [2021/12/23 14:21] (current) – 10.91.120.28
@@ Line 1: / Line 1: @@
 =====Watchdog (#)=====
-**Level:** Warning :?:
+**Level:** Critical :?:
-**Purpose:** Ensure entire alerting pipeline is functional.
+**Purpose:** Alerts operations that the watchdog agent is not running on a server this can lead to support missing critical alerts.
 **Scenario:**
+When a Watchdog cannot start it will generate the Watchdog Agent alert.
+There is an active alarm on the Watchdog Agent.
 **Resolution:**
+Check if watchdog is running on server, restart if necessary.
+Logs are available at watchdog/logs
 **Manual Action Steps:**
+Check for uncleared active alarm on Cerberus server
+<code>select * from active_alarm where cleared = false and context like '%Watchdog%'</code>
+Manually clear Watchdog Agent alarm.
+<code>update snmp_manager.active_alarm set cleared = True where cleared is False and context like '%Watchdog%'</code>
 **Auto Clear:**
+Will clear when issue has been resolved.

Internal Errigal Collaboration Wiki