Level: Critical

Purpose: Alerts if a queue in RabbitMQ has too many unacknowledged messages

Scenario: There have been >1000 unacknowledged messages in a RabbitMQ queue for 1m.

Resolution: Each queue should have a consumer. Check whether the consumer is still running or check the RabbitMQ logs for any connection errors.

Example: orchestratorInboundTask had unacknowledged messages. Restarting the rdf_orchestrator resolved this

Manual Action Steps: Fix consumer of unacknowledged messages

Auto Clear: When unacknowledged message fall below 1000