DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Making Kafka 7,658x slower for the Lulz

Making Kafka 7,658x slower for the Lulz

Comments
7 min read
End-to-End YouTube Channel Analytics Pipeline

End-to-End YouTube Channel Analytics Pipeline

1
Comments
8 min read
🚚 𝗟𝗼𝗴𝗶𝘀𝘁𝗶𝗰𝘀 𝗥𝗼𝘂𝘁𝗲 𝗢𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 — 𝗯𝘂𝗶𝗹𝘁 (𝘀𝗮𝗻𝗲𝗹𝘆) 𝘄𝗶𝘁𝗵 𝗝𝗮𝘃𝗮

🚚 𝗟𝗼𝗴𝗶𝘀𝘁𝗶𝗰𝘀 𝗥𝗼𝘂𝘁𝗲 𝗢𝗽𝘁𝗶𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 — 𝗯𝘂𝗶𝗹𝘁 (𝘀𝗮𝗻𝗲𝗹𝘆) 𝘄𝗶𝘁𝗵 𝗝𝗮𝘃𝗮

2
Comments
2 min read
Building a GlobalStream: Replication Challenges and Optimizations

Building a GlobalStream: Replication Challenges and Optimizations

Comments
5 min read
🚨𝗙𝗶𝗻𝗮𝗻𝗰𝗶𝗮𝗹 𝗙𝗿𝗮𝘂𝗱 𝗗𝗲𝘁𝗲𝗰𝘁𝗶𝗼𝗻 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 𝗶𝗻 𝗝𝗮𝘃𝗮 — 𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝗗𝗲𝗳𝗲𝗻𝘀𝗲 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗠𝗼𝗱𝗲𝗿𝗻 𝗙𝗶𝗻𝗧𝗲𝗰𝗵 𝗦𝘁𝗮𝗰𝗸

🚨𝗙𝗶𝗻𝗮𝗻𝗰𝗶𝗮𝗹 𝗙𝗿𝗮𝘂𝗱 𝗗𝗲𝘁𝗲𝗰𝘁𝗶𝗼𝗻 𝗣𝗶𝗽𝗲𝗹𝗶𝗻𝗲𝘀 𝗶𝗻 𝗝𝗮𝘃𝗮 — 𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝗗𝗲𝗳𝗲𝗻𝘀𝗲 𝗳𝗼𝗿 𝘁𝗵𝗲 𝗠𝗼𝗱𝗲𝗿𝗻 𝗙𝗶𝗻𝗧𝗲𝗰𝗵 𝗦𝘁𝗮𝗰𝗸

2
Comments
2 min read
AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

AI-Driven Data Engineering: Building Real-Time Intelligence Pipelines

Comments
4 min read
𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝘀𝗽𝗼𝗿𝘁𝘀 𝗮𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 𝘄𝗶𝘁𝗵 𝗝𝗮𝘃𝗮 + 𝗔𝗽𝗮𝗰𝗵𝗲 𝗙𝗹𝗶𝗻𝗸 — 𝘁𝗵𝗲 𝘀𝘁𝗮𝗰𝗸 𝘁𝗵𝗮𝘁 𝘁𝘂𝗿𝗻𝘀 𝗹𝗶𝘃𝗲 𝗴𝗮𝗺𝗲𝘀 𝗶𝗻𝘁𝗼 𝗹𝗶𝘃𝗲 𝗱𝗲𝗰𝗶𝘀𝗶𝗼𝗻𝘀.

𝗥𝗲𝗮𝗹-𝘁𝗶𝗺𝗲 𝘀𝗽𝗼𝗿𝘁𝘀 𝗮𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 𝘄𝗶𝘁𝗵 𝗝𝗮𝘃𝗮 + 𝗔𝗽𝗮𝗰𝗵𝗲 𝗙𝗹𝗶𝗻𝗸 — 𝘁𝗵𝗲 𝘀𝘁𝗮𝗰𝗸 𝘁𝗵𝗮𝘁 𝘁𝘂𝗿𝗻𝘀 𝗹𝗶𝘃𝗲 𝗴𝗮𝗺𝗲𝘀 𝗶𝗻𝘁𝗼 𝗹𝗶𝘃𝗲 𝗱𝗲𝗰𝗶𝘀𝗶𝗼𝗻𝘀.

1
Comments
2 min read
Kafka Self-Healing Cluster:

Kafka Self-Healing Cluster:

Comments 1
2 min read
🔥 𝗔𝗱-𝗧𝗲𝗰𝗵 𝗔𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 𝗮𝘁 𝗦𝗰𝗮𝗹𝗲 — 𝗕𝘂𝗶𝗹𝘁 𝗼𝗻 𝗝𝗮𝘃𝗮 𝗠𝗶𝗰𝗿𝗼𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀

🔥 𝗔𝗱-𝗧𝗲𝗰𝗵 𝗔𝘂𝗰𝘁𝗶𝗼𝗻 𝗦𝘆𝘀𝘁𝗲𝗺𝘀 𝗮𝘁 𝗦𝗰𝗮𝗹𝗲 — 𝗕𝘂𝗶𝗹𝘁 𝗼𝗻 𝗝𝗮𝘃𝗮 𝗠𝗶𝗰𝗿𝗼𝘀𝗲𝗿𝘃𝗶𝗰𝗲𝘀

2
Comments
2 min read
🛒 𝗗𝗲𝘀𝗶𝗴𝗻𝗶𝗻𝗴 𝗠𝘂𝗹𝘁𝗶-𝗥𝗲𝗴𝗶𝗼𝗻 𝗘-𝗖𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗖𝗵𝗲𝗰𝗸𝗼𝘂𝘁 𝗶𝗻 𝗝𝗮𝘃𝗮 (𝘁𝗵𝗮𝘁 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝘀𝘂𝗿𝘃𝗶𝘃𝗲𝘀 𝗕𝗹𝗮𝗰𝗸 𝗙𝗿𝗶𝗱𝗮𝘆)

🛒 𝗗𝗲𝘀𝗶𝗴𝗻𝗶𝗻𝗴 𝗠𝘂𝗹𝘁𝗶-𝗥𝗲𝗴𝗶𝗼𝗻 𝗘-𝗖𝗼𝗺𝗺𝗲𝗿𝗰𝗲 𝗖𝗵𝗲𝗰𝗸𝗼𝘂𝘁 𝗶𝗻 𝗝𝗮𝘃𝗮 (𝘁𝗵𝗮𝘁 𝗮𝗰𝘁𝘂𝗮𝗹𝗹𝘆 𝘀𝘂𝗿𝘃𝗶𝘃𝗲𝘀 𝗕𝗹𝗮𝗰𝗸 𝗙𝗿𝗶𝗱𝗮𝘆)

1
Comments
2 min read
Integration Digest for September 2025

Integration Digest for September 2025

Comments
11 min read
Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Building a Real-Time Binance Data Pipeline with Kafka and PostgreSQL

Comments
2 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
7 min read
Introduction to Live Streaming Architecture

Introduction to Live Streaming Architecture

9
Comments
6 min read
Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Apache Kafka Deep Dive: Core Concepts, Data Engineering Applications, and Real-World Production Practices

Comments
4 min read
Event-Driven Architecture with Blockchain: Use Kafka/MSK and Blockchain Logs

Event-Driven Architecture with Blockchain: Use Kafka/MSK and Blockchain Logs

Comments
2 min read
How to Use Kubernetes Metadata for Dynamic Kafka Topics in Fluent Bit

How to Use Kubernetes Metadata for Dynamic Kafka Topics in Fluent Bit

Comments
3 min read
Streaming Data Using Apache Kafka

Streaming Data Using Apache Kafka

1
Comments
2 min read
📌 Kafka Auth in 2025

📌 Kafka Auth in 2025

1
Comments
1 min read
The Offset Reset Dilemma: Avoiding Surprise Replays in Kafka

The Offset Reset Dilemma: Avoiding Surprise Replays in Kafka

Comments
1 min read
Apache Kafka in Data Engineering

Apache Kafka in Data Engineering

Comments
1 min read
All About Change Data Capture CDC

All About Change Data Capture CDC

1
Comments
6 min read
Automate Your AWS MSK Kafka Cluster with Terraform: A Complete Guide

Automate Your AWS MSK Kafka Cluster with Terraform: A Complete Guide

2
Comments
5 min read
A Beginner's Guide to AWS MSK: From Cluster Setup to Your First Message

A Beginner's Guide to AWS MSK: From Cluster Setup to Your First Message

7
Comments
5 min read
loading...