DEV Community

#datapipeline

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
WebSocket silent data gap in market feed

WebSocket silent data gap in market feed

Comments
3 min read
Kafka internals via rebuild: what using a tool vs. understanding it teaches you

Kafka internals via rebuild: what using a tool vs. understanding it teaches you

Comments
3 min read
Hidden complexity of building WebSocket servers from scratch

Hidden complexity of building WebSocket servers from scratch

Comments
3 min read
The Hidden Complexity of Keeping a WebSocket Alive in Production

The Hidden Complexity of Keeping a WebSocket Alive in Production

Comments
4 min read
Why Data Engineering Is the Oldest Profession in Infrastructure

Why Data Engineering Is the Oldest Profession in Infrastructure

Comments
4 min read
Your Messaging Architecture Is Probably Being Driven by Habit, Not Requirements

Your Messaging Architecture Is Probably Being Driven by Habit, Not Requirements

Comments
4 min read
The Compression Layer Nobody Thinks About Until It's Too Late

The Compression Layer Nobody Thinks About Until It's Too Late

Comments 2
4 min read
The Real Reason Your Climate Data Project Is Taking Forever

The Real Reason Your Climate Data Project Is Taking Forever

Comments
4 min read
Your Kafka Streams Pipeline Shouldn't Crash Because of One Bad Record

Your Kafka Streams Pipeline Shouldn't Crash Because of One Bad Record

Comments
4 min read
Your Data Warehouse Is Not Your Data Pipeline

Your Data Warehouse Is Not Your Data Pipeline

Comments
6 min read
Stop Defaulting to WebSockets: The Protocol Choice That Will Haunt Your Architecture

Stop Defaulting to WebSockets: The Protocol Choice That Will Haunt Your Architecture

Comments
3 min read
What Stock Market Infrastructure Taught Me About Building Pipelines That Don't Lie to You

What Stock Market Infrastructure Taught Me About Building Pipelines That Don't Lie to You

Comments
4 min read
Your Data Pipeline Has No Idea What "Reliable" Actually Means

Your Data Pipeline Has No Idea What "Reliable" Actually Means

Comments
4 min read
Your Space Data Pipeline Will Fail at the Worst Possible Moment — Here's How to Stop That

Your Space Data Pipeline Will Fail at the Worst Possible Moment — Here's How to Stop That

Comments
4 min read
The Compliance API Is Not a Checkbox — It's Load-Bearing Infrastructure

The Compliance API Is Not a Checkbox — It's Load-Bearing Infrastructure

Comments
4 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.