Centralized Logs Management with Logtash, ElasticSearch, and Redis
Deploying a Centralized Logs Management System seems very easy these days with such these great tools: + Logtash : collect logs, index logs, process logs, and ship logs + Redis : receive logs from logs shippers + ElasticSearch : store logs + Kibana : web interface with graphs, tables... We will implement the logs management system as the following architecture: (based on this article: http://michael.bouvy.net/blog/en/2013/11/19/collect-visualize-your-logs-logstash-elasticsearch-redis-kibana/ ) In this tutorial, I only deploy one shipper (nginx logs of my Django app) on one machine, and one server to play as logs indexer (redis, logstash, elasticsearch, kibana): 1. On the indexer server, i nstall and run Redis : http://iambusychangingtheworld.blogspot.com/2013/11/install-redis-and-run-as-service.html 2. O n the indexer server, i nstall and run ElasticSearch : $ sudo aptitude install openjdk-6-jre $ wget https://download.elasticsearch.org/elasticsea...