Kafka High Availability in Multi Data Center Setup with Floating Observers
Date : April 26, 2022
Time : 3:15 PM - 3:25 PM

Enabling High Availability in cluster setup that spawns different data centers is challenging but it is even more if we are using just two data-centers. Not ideal for Kafka HA at all. But this is reality for most organizations as they are using the same data-centers previously used for database HA. In this presentation we will see how to use Kafka Observer feature to address this challenge with additional tweak to distribute load evenly among Observers and ordinary Brokers and make them floating between data-centers. The whole demo is supported by Infrastructure as a code automation trough Ansible.

Dalibor Blazevic
Lead Architect, Sysco AS
Phong Pham
Managing Consultant Software Development, Sysco AS