DEV Community

Manish Thakurani for CodeGreen

Posted on

What is Apache Kafka? explain architecture of Kafka

Apache Kafka

============

Apache Kafka is an open-source distributed event streaming platform used for building real-time data pipelines and streaming applications.

Architecture of Kafka

Kafka has a distributed architecture consisting of the following components:

  • Producer: Applications that produce data and send it to Kafka topics.
  • Broker: Kafka runs as a cluster of one or more servers called brokers, which store and manage the data.
  • Topic: A category or feed name to which messages are published by producers.
  • Partition: Topics are divided into partitions for scalability and parallelism.
  • Consumer: Applications that subscribe to topics and consume the data.
  • ZooKeeper: Coordinates and manages Kafka brokers.

The architecture allows for horizontal scaling, fault tolerance, and high throughput.

Architecture of Kafka

Top comments (0)