Hope is Not a Course of Action! A Practical Deep Dive into Observability of Streaming Applications
Date : May 17, 2023
Time : 9:00 AM - 9:45 AM

You build your streaming applications and event-driven microservices using Apache Kafka. Are your systems observable enough without depending only on the broker-side metrics and application logs? Can you track down the root cause during incidents, or do you hope everything will be fine after a restart? In this talk, Tim & Kosta will take you on their observability journey by sharing pitfalls and knowledge our team gained over the last couple of years. We are going to answer questions like: * Do you understand how to expose and use your client-side Kafka metrics? * JMX, Metric interceptors, Micrometer where to start? * Why is there a difference between the values of client-side and broker-side metrics? * Learn how client-side consumer lag metrics can differ from the lag calculated on the cluster. * What is the right way to use and interpret them? * Can you measure latency through your complete stack using distributed tracing? * OpenTelemetry, Jaeger & Zipkin, what to pick? During a step-by-step demo, we will look into different real-life examples and scenarios to demonstrate how to bring the observability of your Kafka applications to the next level. Kickstart your observability journey today and join this talk!

Speakers
speakerimage
Tim van Baarsen
Senior Software Engineer, ING
speakerimage
Kosta Chuturkov
Software Engineer, ING