Differences

This shows you the differences between two versions of the page.

--- development:applications:kibana-elasticsearch-filebeat [2017/12/04 15:59] – added page adsilva
+++ development:applications:kibana-elasticsearch-filebeat [2021/06/25 10:09] (current) – external edit 127.0.0.1
@@ Line 1: / Line 1: @@
+=== Centralized Logging with Filebeat, ElasticSearch and Kibana ===
+As of the time of writing this, the logs are stored on the server where the application runs. The process of debugging, searching and garnering insights on the logs is very difficult.
+Hence,  Filebeat along with Elastic Search and Kibana has been used to make this process simpler.
+**The architecture of this setup is as follows:**
+{{ :development:applications:centralized-logging.png?600 |}}
+As we can see in the diagram, Filebeat is a light weight local daemon that runs on every server where our applications run.
+The only job of a Filebeat daemon is to collect logs from multiple log files that are generated within a server and publish them over to Elastic Search.
+The path to one or more log files can be configured through a "//filebeat.yml//" file. This file also contains the necessary information to connect to the Elastic Search instance.
+=== Role of Elastic Search ===
+The role of the Elastic search instance is to store and index the logs as per the format sent by Filebeat and to allow for future searching and retrieval.
+=== Role of Kibana ===
+Kibana acts as an UI and allows for visualizing, analyzing, and exploring logs stored within Elastic search.
+=== Technical Information ===
+The Filebeat binary is usually deployed to ///var/filebeat// with the //filebeat.yml// configuration file being present in the same directory.
+The deployment is done through a Filebeat Ansible Role, for more information, refer [[https://bitbucket.org/errigal/filebeat/]]

Sidebar

Internal Errigal Collaboration Wiki

Differences

Sidebar

Internal Errigal Collaboration Wiki

User Tools

Site Tools

Differences

Page Tools