User Tools

Site Tools


Writing /app/www/public/data/meta/resolution_area/prometheus_resolutions/res-p1202.meta failed
resolution_area:prometheus_resolutions:res-p1202

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision
Previous revision
resolution_area:prometheus_resolutions:res-p1202 [2021/06/24 12:02] btobinresolution_area:prometheus_resolutions:res-p1202 [2021/07/05 12:32] (current) 10.91.120.28
Line 1: Line 1:
 +=====HeapLowGrails=====
  
 +**Level:** __Critical__ FIXME
 +
 +
 +**Purpose:** Identify when one of the Errigal Grails Application is using an excessive amount of heap memory for a defined duration of time.
 +
 +**Scenario:** ReportingManager on EXTApps2 used more than 90% of its Heap for 120s. Typical reason in this instance would be a rogue report run with very broad input variable e.g a trap report specifying range of over year.
 +
 +**Resolution:** Monitor to see if heap usage is reducing. If not and it becomes evident that the application will run out of memory, perform a restart of the application.
 +
 +**Manual Action Steps:**
 +\\
 +Script Based Restart
 +<code>
 +cd /var/tomcat/ReportingManager/bin/
 +./shutdown.sh
 +ps aux | grep -i Reporting 
 +(Kill process if still running: kill $pid)
 +./startup.sh
 +</code>
 +
 +Ansible Based Restart
 +<code>
 +ansible-playbook -i ../env-configuration/${env}/hosts.ini --diff --vault-id @prompt reportingmanager.yml -e "actions='stop,start'" --limit $appHandler
 +</code>
 +**Auto Clear:** Yes