DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
How to Ingest Your Legacy Database to Snowflake

How to Ingest Your Legacy Database to Snowflake

Comments
15 min read
Kafka Producer Deep Dive: From Basics to Production-Ready Configuration

Kafka Producer Deep Dive: From Basics to Production-Ready Configuration

Comments
6 min read
From Chaos to Clarity: Building a Robust Log Aggregation Pipeline with Kafka (KRaft) and ELK

From Chaos to Clarity: Building a Robust Log Aggregation Pipeline with Kafka (KRaft) and ELK

Comments
8 min read
Event-Driven Architecture 101: Building a Simple App with Kafka - By Gopi Gugan

Event-Driven Architecture 101: Building a Simple App with Kafka - By Gopi Gugan

Comments
3 min read
SQL on Kafka Data Does Not Require a Streaming Engine

SQL on Kafka Data Does Not Require a Streaming Engine

Comments
4 min read
Building a Kafka Wikimedia Producer: Solving 403 Errors and Understanding Java Fundamentals

Building a Kafka Wikimedia Producer: Solving 403 Errors and Understanding Java Fundamentals

Comments
9 min read
Kafka interview questions for Data Engineer

Kafka interview questions for Data Engineer

3
Comments
3 min read
The Messaging Challenges No One Talks About in Regulated, Air-Gapped, and Hybrid Environments

The Messaging Challenges No One Talks About in Regulated, Air-Gapped, and Hybrid Environments

Comments
5 min read
Kafka Ingestion & Processing at Scale | Rajamohan Jabbala

Kafka Ingestion & Processing at Scale | Rajamohan Jabbala

Comments
2 min read
Federated Learning System for IoT Devices (Anomaly Detection)

Federated Learning System for IoT Devices (Anomaly Detection)

Comments
1 min read
Building a Kafka Event-Driven Spring Boot Application with Avro, Schema Registry and PostgreSQL

Building a Kafka Event-Driven Spring Boot Application with Avro, Schema Registry and PostgreSQL

1
Comments
2 min read
Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern

Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern

Comments
3 min read
Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Comments
2 min read
Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Comments
10 min read
Data Processing Does Not Belong in the Message Broker

Data Processing Does Not Belong in the Message Broker

Comments
3 min read
ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

Comments
4 min read
Mastering Event-Driven Systems with Kafka & Redpanda

Mastering Event-Driven Systems with Kafka & Redpanda

Comments
2 min read
Stateless Kafka-compatible brokers backed by object storage, k8s native

Stateless Kafka-compatible brokers backed by object storage, k8s native

Comments
1 min read
Kafka’s Broker As A Traffic Cop

Kafka’s Broker As A Traffic Cop

Comments
12 min read
Interesting links - December 2025

Interesting links - December 2025

Comments
13 min read
S3-Native Kafka Alternatives: What's Actually Different

S3-Native Kafka Alternatives: What's Actually Different

Comments
3 min read
Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Comments 1
10 min read
When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

Comments
4 min read
Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

5
Comments
5 min read
The Big Data Showdown: Apache Spark vs. Hadoop in 2026

The Big Data Showdown: Apache Spark vs. Hadoop in 2026

5
Comments
4 min read
loading...