DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

๐Ÿ‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
How to build real-time user-facing analytics with Kafka + Flink + Doris

How to build real-time user-facing analytics with Kafka + Flink + Doris

4
Comments
9 min read
Kafka Streams Make AI Agents Fraud Detection Smarter

Kafka Streams Make AI Agents Fraud Detection Smarter

Comments
7 min read
JayNats: The Future of Message Brokers

JayNats: The Future of Message Brokers

Comments
5 min read
Docker Compose - Simple Kafka

Docker Compose - Simple Kafka

Comments
1 min read
How Software Architects Choose the Right Technology Stack

How Software Architects Choose the Right Technology Stack

1
Comments
3 min read
Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

Fault-Tolerant Realtime Data Ingestion with QuestDB Write-Ahead Logs

5
Comments
2 min read
Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Data Intelligence Tokyo #20: Managing Schemas with Apache Kafka

Comments
1 min read
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)

Comments
3 min read
Good Things (Compression) Take Time!

Good Things (Compression) Take Time!

1
Comments
6 min read
A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

A new tool to automatically detect and fix common Apache Kafka issues (looking for feedback)

6
Comments
1 min read
Building a Simple Event-Driven Microservices System with Apache Kafka

Building a Simple Event-Driven Microservices System with Apache Kafka

3
Comments
2 min read
Making Kafka 7,658x slower for theย Lulz

Making Kafka 7,658x slower for theย Lulz

Comments
7 min read
๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

๐Ÿšš ๐—Ÿ๐—ผ๐—ด๐—ถ๐˜€๐˜๐—ถ๐—ฐ๐˜€ ๐—ฅ๐—ผ๐˜‚๐˜๐—ฒ ๐—ข๐—ฝ๐˜๐—ถ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ โ€” ๐—ฏ๐˜‚๐—ถ๐—น๐˜ (๐˜€๐—ฎ๐—ป๐—ฒ๐—น๐˜†) ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
You don't need Kafka: Building a message queue with only two UNIX signals

You don't need Kafka: Building a message queue with only two UNIX signals

5
Comments
15 min read
๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

๐Ÿšจ๐—™๐—ถ๐—ป๐—ฎ๐—ป๐—ฐ๐—ถ๐—ฎ๐—น ๐—™๐—ฟ๐—ฎ๐˜‚๐—ฑ ๐——๐—ฒ๐˜๐—ฒ๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฃ๐—ถ๐—ฝ๐—ฒ๐—น๐—ถ๐—ป๐—ฒ๐˜€ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ โ€” ๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐——๐—ฒ๐—ณ๐—ฒ๐—ป๐˜€๐—ฒ ๐—ณ๐—ผ๐—ฟ ๐˜๐—ต๐—ฒ ๐— ๐—ผ๐—ฑ๐—ฒ๐—ฟ๐—ป ๐—™๐—ถ๐—ป๐—ง๐—ฒ๐—ฐ๐—ต ๐—ฆ๐˜๐—ฎ๐—ฐ๐—ธ

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

๐—ฅ๐—ฒ๐—ฎ๐—น-๐˜๐—ถ๐—บ๐—ฒ ๐˜€๐—ฝ๐—ผ๐—ฟ๐˜๐˜€ ๐—ฎ๐—ป๐—ฎ๐—น๐˜†๐˜๐—ถ๐—ฐ๐˜€ ๐˜„๐—ถ๐˜๐—ต ๐—๐—ฎ๐˜ƒ๐—ฎ + ๐—”๐—ฝ๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—™๐—น๐—ถ๐—ป๐—ธ โ€” ๐˜๐—ต๐—ฒ ๐˜€๐˜๐—ฎ๐—ฐ๐—ธ ๐˜๐—ต๐—ฎ๐˜ ๐˜๐˜‚๐—ฟ๐—ป๐˜€ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ด๐—ฎ๐—บ๐—ฒ๐˜€ ๐—ถ๐—ป๐˜๐—ผ ๐—น๐—ถ๐˜ƒ๐—ฒ ๐—ฑ๐—ฒ๐—ฐ๐—ถ๐˜€๐—ถ๐—ผ๐—ป๐˜€.

1
Comments
2 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

๐Ÿ”ฅ ๐—”๐—ฑ-๐—ง๐—ฒ๐—ฐ๐—ต ๐—”๐˜‚๐—ฐ๐˜๐—ถ๐—ผ๐—ป ๐—ฆ๐˜†๐˜€๐˜๐—ฒ๐—บ๐˜€ ๐—ฎ๐˜ ๐—ฆ๐—ฐ๐—ฎ๐—น๐—ฒ โ€” ๐—•๐˜‚๐—ถ๐—น๐˜ ๐—ผ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ ๐— ๐—ถ๐—ฐ๐—ฟ๐—ผ๐˜€๐—ฒ๐—ฟ๐˜ƒ๐—ถ๐—ฐ๐—ฒ๐˜€

2
Comments
2 min read
๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

๐Ÿ›’ ๐——๐—ฒ๐˜€๐—ถ๐—ด๐—ป๐—ถ๐—ป๐—ด ๐— ๐˜‚๐—น๐˜๐—ถ-๐—ฅ๐—ฒ๐—ด๐—ถ๐—ผ๐—ป ๐—˜-๐—–๐—ผ๐—บ๐—บ๐—ฒ๐—ฟ๐—ฐ๐—ฒ ๐—–๐—ต๐—ฒ๐—ฐ๐—ธ๐—ผ๐˜‚๐˜ ๐—ถ๐—ป ๐—๐—ฎ๐˜ƒ๐—ฎ (๐˜๐—ต๐—ฎ๐˜ ๐—ฎ๐—ฐ๐˜๐˜‚๐—ฎ๐—น๐—น๐˜† ๐˜€๐˜‚๐—ฟ๐˜ƒ๐—ถ๐˜ƒ๐—ฒ๐˜€ ๐—•๐—น๐—ฎ๐—ฐ๐—ธ ๐—™๐—ฟ๐—ถ๐—ฑ๐—ฎ๐˜†)

1
Comments
2 min read
Integration Digest for September 2025

Integration Digest for September 2025

Comments
11 min read
Kafka | everything you need to get started

Kafka | everything you need to get started

Comments
5 min read
Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Comments
2 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
loading...