User Tools
resolution_area:prometheus_resolutions:res-p1202
HeapLowGrails
Level: Critical
Purpose: Identify when one of the Errigal Grails Application is using an excessive amount of heap memory for a defined duration of time.
Scenario: ReportingManager on EXTApps2 used more than 90% of its Heap for 120s. Typical reason in this instance would be a rogue report run with very broad input variable e.g a trap report specifying range of over year.
Resolution: Monitor to see if heap usage is reducing. If not and it becomes evident that the application will run out of memory, perform a restart of the application.
Manual Action Steps:
Script Based Restart
cd /var/tomcat/ReportingManager/bin/ ./shutdown.sh ps aux | grep -i Reporting (Kill process if still running: kill $pid) ./startup.sh
Ansible Based Restart
ansible-playbook -i ../env-configuration/${env}/hosts.ini --diff --vault-id @prompt reportingmanager.yml -e "actions='stop,start'" --limit $appHandler
Auto Clear: Yes
resolution_area/prometheus_resolutions/res-p1202.txt · Last modified: 2021/07/05 12:32 by 10.91.120.28