DEV Community

#kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Lambda with Kafka queues: parallelism past partitions, and what it costs
fernando_azevedo_6844e930 profile

Lambda with Kafka queues: parallelism past partitions, and what it costs

#awscloud #kafka #awslambda #eventdriven
Comments
8 min read
The transactional outbox: stop losing events between your database and Kafka
ayushwing profile

The transactional outbox: stop losing events between your database and Kafka

#kafka #distributedsystems #microservices #java
Comments
4 min read
Queue vs Topic vs Log: Picking the Broker
aloknecessary profile

Queue vs Topic vs Log: Picking the Broker

#azure #aws #kafka #distributedsystems
Comments
4 min read
IBM Owns Confluent. Kafka Users Still Have a Runtime Problem.
andrew_tan_layline profile

IBM Owns Confluent. Kafka Users Still Have a Runtime Problem.

#kafka #ibm #watsonx #layline
Comments
5 min read
Cutting LLM Calls in Incident Triage: Sliding Windows, Log Reduction, and a pgvector Cache
axololtos_30 profile

Cutting LLM Calls in Incident Triage: Sliding Windows, Log Reduction, and a pgvector Cache

#java #kafka #postgres #ai
Comments
6 min read
Proving exactly-once by killing the stream mid-backlog
tantn89 profile

Proving exactly-once by killing the stream mid-backlog

#dataengineering #spark #iceberg #kafka
Comments 3
8 min read
The schema registry approved a change that only worked if we deployed first
sergey_shinder_ab2d943365 profile

The schema registry approved a change that only worked if we deployed first

#sergeyshinder #kafka #integration #avro
Comments
2 min read
CDC Schema Changes: What Breaks and How to Ship Them
pipelinewhiteboard profile

CDC Schema Changes: What Breaks and How to Ship Them

#dataengineering #kafka #snowflake #database
Comments
7 min read
Why Scaling Kafka Consumers Is Harder Than Just Adding Pods
null_pointer_exp profile

Why Scaling Kafka Consumers Is Harder Than Just Adding Pods

#kafka #java #springboot #architecture
Comments
4 min read
CDC Deletes, Tombstones and the Idempotent MERGE
pipelinewhiteboard profile

CDC Deletes, Tombstones and the Idempotent MERGE

#dataengineering #kafka #snowflake #sql
Comments
7 min read
Why Netflix Won't Write to Two Databases at Once: Change Data Capture Explained
system_design_lab profile

Why Netflix Won't Write to Two Databases at Once: Change Data Capture Explained

#database #systemdesign #kafka #beginners
1
Comments
5 min read
Designing a Notification System for an E-commerce App
krishanu_das profile

Designing a Notification System for an E-commerce App

#systemdesign #architecture #kafka #redis
Comments
6 min read
From Sensor Data to Smart Alerts: Building an Energy Monitoring Pipeline with Python and Kafka
supraja_chinthala_703d1f0 profile

From Sensor Data to Smart Alerts: Building an Energy Monitoring Pipeline with Python and Kafka

#ai #python #kafka #architecture
Comments
7 min read
We added a sleep before shutdown and our pods ran out of time to shut down
sergey_shinder_ab2d943365 profile

We added a sleep before shutdown and our pods ran out of time to shut down

#sergeyshinder #kubernetes #containers #kafka
Comments
2 min read
Kafka producer configuration for .NET real-time streams: Tuning for Low Latency & High Throughput
amitesh0512 profile

Kafka producer configuration for .NET real-time streams: Tuning for Low Latency & High Throughput

#kafka #net #performancetuning #realtimestreamingnet
Comments
7 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.