Controller & ZooKeeper/Kraft Roles
Understand the critical functions of the Kafka Controller and the underlying consensus mechanism (ZooKeeper or Kraft) in cluster management.
The Brain of a Kafka Cluster
Imagine a bustling city. To keep everything running smoothly, you need a central command center, right?
A Kafka cluster, with its many brokers and distributed data, also needs a 'brain' to coordinate its activities. This is where the Kafka Controller comes in.
Introducing the Kafka Controller
The Kafka Controller is a special role taken on by one of the Kafka brokers in the cluster. Only one broker can be the controller at any given time.
- It's elected from the available brokers.
- It acts as the primary coordinator for the entire cluster.
- If the current controller fails, another broker is elected to take its place.
All lessons in this course
- Replication & Fault Tolerance
- Controller & ZooKeeper/Kraft Roles
- Designing a Kafka Cluster
- Rack Awareness & Multi-AZ Placement