DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Comments
3 min read
How to trace across message queue - kafka, without writing a log and trace

How to trace across message queue - kafka, without writing a log and trace

Comments
4 min read
Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Orchestrating Complex Processes in Node.js with @jescrich/nestjs-workflow

Comments
3 min read
🧠 Kafka Broker vs Controller - Complete Guide

🧠 Kafka Broker vs Controller - Complete Guide

1
Comments
5 min read
Understanding Kafka Lag: Causes and Mitigation Strategies

Understanding Kafka Lag: Causes and Mitigation Strategies

Comments
4 min read
Building a Real-Time Crypto Data Pipeline with Debezium CDC

Building a Real-Time Crypto Data Pipeline with Debezium CDC

Comments
5 min read
Did I just create the fastest BPMN engine in the world?

Did I just create the fastest BPMN engine in the world?

Comments
1 min read
Undestanding Kafka Lag, Why It Happens and How To Fix It.

Undestanding Kafka Lag, Why It Happens and How To Fix It.

2
Comments
4 min read
Demystifying Confluent's Schema Registry Wire Format

Demystifying Confluent's Schema Registry Wire Format

Comments
13 min read
Reducing Consumer Lag in Apache Kafka

Reducing Consumer Lag in Apache Kafka

5
Comments
3 min read
🎯 Kafka Complete Architecture Flow - Advanced

🎯 Kafka Complete Architecture Flow - Advanced

1
Comments 1
6 min read
Kafka Architecture - The Complete Mental Model 🧠

Kafka Architecture - The Complete Mental Model 🧠

3
Comments 1
7 min read
Understanding Kafka Lag: Causes and How to Reduce It

Understanding Kafka Lag: Causes and How to Reduce It

Comments
5 min read
Wednesday Links - Edition 2025-11-05

Wednesday Links - Edition 2025-11-05

Comments
2 min read
Integration Digest for October 2025

Integration Digest for October 2025

Comments
12 min read
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
Building a Mini Kafka in Go — My Journey Creating go-pub-sub

Building a Mini Kafka in Go — My Journey Creating go-pub-sub

1
Comments
4 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Comments
1 min read
Kafka Backfill Patterns: A Guide to Accessing Historical Data

Kafka Backfill Patterns: A Guide to Accessing Historical Data

5
Comments
7 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

2
Comments
1 min read
loading...