DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
What AI Agents Taught Me About Building Databricks Apps

What AI Agents Taught Me About Building Databricks Apps

Comments
7 min read
Six things that break when a data microservice goes to production

Six things that break when a data microservice goes to production

Comments
4 min read
Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End

Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End

Comments
4 min read
Testing PySpark Data Quality in CI: A Practical Retail Media Example

Testing PySpark Data Quality in CI: A Practical Retail Media Example

Comments
5 min read
Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once

Comments
6 min read
Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table

Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table

Comments
3 min read
I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false

I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false

Comments
3 min read
Don't mock BigQuery, test on BigQuery: the rewrite of BigTesty

Don't mock BigQuery, test on BigQuery: the rewrite of BigTesty

Comments
7 min read
Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.

Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.

Comments
9 min read
DuckDB vs Spark: which workloads actually need a cluster

DuckDB vs Spark: which workloads actually need a cluster

Comments
3 min read
Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi

Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi

Comments
3 min read
I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them

1
Comments
8 min read
Your BI Quote Is Really a Data Quote

Your BI Quote Is Really a Data Quote

Comments
2 min read
Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts

Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts

2
Comments
4 min read
The real work in a data agent is the harness around it

The real work in a data agent is the harness around it

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.