In this blog, I’ll show you how can we install ELK on our windows 10 machine - that is ElasticSearch, Logstash, and Kibana.
These three different products are most commonly used together for log analysis. Using ELK stack, we can achieve centralized logging which helps in identifying the problems.
It is the data collection pipeline tool. It is the first component of ELK Stack which collects data inputs and feeds it to the Elasticsearch. It collects various types of data from different sources, all at once and makes it available immediately for further use.
It is a NoSQL database which is based on Lucene search engine and is built with RESTful APIs. It is a highly flexible and distributed search and analytics engine. Also, it provides simple deployment, maximum reliability, and easy management through horizontal scalability. It provides advanced queries to perform detailed analysis and stores all the data centrally for quick search of the documents.
Kibana is a data visualization tool. It is used for visualizing the Elasticsearch documents and helps the developers to have an immediate insight into it. Kibana dashboard provides various interactive diagrams, geospatial data, timelines, and graphs to visualize the complex queries done using Elasticsearch. Using Kibana you can create and save custom graphs according to your specific needs.
These three different products are most commonly used together for log analysis. Using ELK stack, we can achieve centralized logging which helps in identifying the problems.
ELK is heavily used in microservices architecture where your docker images are running on 1000's of POD and you can't go to each pod to trace the logs.
Logstash:
Elasticsearch:
It is a NoSQL database which is based on Lucene search engine and is built with RESTful APIs. It is a highly flexible and distributed search and analytics engine. Also, it provides simple deployment, maximum reliability, and easy management through horizontal scalability. It provides advanced queries to perform detailed analysis and stores all the data centrally for quick search of the documents.
Kibana:
Kibana is a data visualization tool. It is used for visualizing the Elasticsearch documents and helps the developers to have an immediate insight into it. Kibana dashboard provides various interactive diagrams, geospatial data, timelines, and graphs to visualize the complex queries done using Elasticsearch. Using Kibana you can create and save custom graphs according to your specific needs.
Download
You can download all the zip from here
Unzip all the three folders to get their folder files.
Install ElasticSearch
- Open ElasticSearch folder and go to its bin folder.
- Run ElasticSearch to start the ElasticSearch server.
- Once started, go to browser and type localhost:9200
Install Kibana
- Open Kibana folder and go to its bin folder.
- Run kibana.bat file to start the Kibana server.
- Once started, go to browser and type localhost:5601
Install Logstash
- Logstash is a pipeline that pushes data to elasticSearch. So, before starting the Logstash. We have to create one config file.
- Logstash config file will be having three parts i.e. input, filter (Optional) & output.
- Create logstash.conf file under ${logstash}/conf folder. it will simply take the input from the console and push it to ElasticSearch.
- Run below command to start Logstash server and it will wait for the input to push it to elasticsearch.
bin\logstash -f .\config\logstash.conf
- Once started, go to browser and type localhost:9600
- To push the data, I have copied the log file of one project to the console.
- Once done, go to Kibana portal, Management-> Index Patterns -> Create Index pattern. You will observe that logstashdemo which we have set in logstash.conf file is already present here. Now define Kibana index by setting the same name and click on next step button.
- Add @timestamp to set Default time and click on Create Index Pattern.
- Index has been created. Now, to view the data, go to discover tab and click on message (All the logs will be pushed under message index)
Congratulation! We are done with the ELK Setup on Windows 10
No comments:
Post a Comment