Kafka Observability with Elastic Stack

Kafka is a distributed, highly available event streaming platform that can be run on bare metal, virtualized, containerized, or as a managed service. There are many ways to use Kafka alongside the Elastic Stack. You can configure Metricbeat (metrics) or Filebeat to send data to Kafka topics, you can send data from Kafka to Logstash or from Logstash to Kafka, or, you can use Elastic Observability to monitor Kafka and ZooKeeper, so you can keep a close eye on your cluster, which is what this talk will cover. We'll also see how to leverage hints to allow you to automatically monitor new instances of Kafka, use Ingest pipelines for parsing data, visualizing it with Kibana in Elastic Observability.

Aravind Putrevu
Developer Advocate - India & ASEAN, Elastic