ELK Stack

Observations

  • Logs management and analytics
  • ELK stack was first introduced by Elastic and was open source. However, the changed it to licensed from open source
  • AWS launched OpenSearch as replacement for ELK which was open source.
  • Logstash collects the logs data, applies transformations passes onto elasticsearch which indexes and stores the data. Kibana is then used to visualize the data.

Elasticsearch

Text search and analytics engine based on apache Lucene open source search engine.

Logstash

Logs aggregator and data collector from various sources, execute different transformations and enhancements and ship the data to various supported destinations.

Kibana

Visualization tool works on top of elasticsearch.