Increasing Kafka Connect Throughput
Date : April 25, 2022
Time : 5:30 PM - 5:40 PM
While Apache Kafka® is the central nervous system for streaming data, Kafka Connect is the highway that allows traffic to flow in and out of Kafka without the need to write a producer/consumer. The question that arises here is how do we fit more cars (records) on this highway and get better throughput? In this presentation, we will use JDBC source connector as examples of how to tune a source connector: * Elaborate internals of source(client/producer) * List of configurations to tune for producer * List of configurations to tune from source JDBC connector * Validate record count * Which metrics to monitor * Throughput results of tuned vs untuned Let us Connect all of our systems through the largest possible highway!
Speakers

Catalin Pop
Staff Technical Support Engineer, Confluent