DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
The pipeline passed. The data still needs proof.

The pipeline passed. The data still needs proof.

Comments 1
3 min read
Your Fraud Engine's Search Is Either a Librarian or a Scholar. It Needs to Be Both.

Your Fraud Engine's Search Is Either a Librarian or a Scholar. It Needs to Be Both.

1
Comments
4 min read
Databricks Workflows vs Airflow vs Dagster: Picking an Orchestrator

Databricks Workflows vs Airflow vs Dagster: Picking an Orchestrator

Comments
5 min read
Why Online Doctor Directories Keep Letting You Down

Why Online Doctor Directories Keep Letting You Down

Comments
4 min read
DSA Is Dead. What Replaced It Is Somehow Worse.

DSA Is Dead. What Replaced It Is Somehow Worse.

Comments
7 min read
How to Build a Resilient Edge Data Pipeline for Power Line Sensors

How to Build a Resilient Edge Data Pipeline for Power Line Sensors

Comments
8 min read
Knowledge Graphs Beyond Fraud: The Substrate Insurance AI Actually Needs

Knowledge Graphs Beyond Fraud: The Substrate Insurance AI Actually Needs

Comments
3 min read
Data Contracts: Ending the "Someone Changed a Field Upstream" Outage

Data Contracts: Ending the "Someone Changed a Field Upstream" Outage

Comments
2 min read
Your scraper isn't broken. The site changed, and it didn't tell you.

Your scraper isn't broken. The site changed, and it didn't tell you.

Comments 1
4 min read
Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables

Comparing the Permission Models of the Iceberg REST APIs Provided by Glue Data Catalog and S3 Tables

5
Comments 2
9 min read
Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.

Your BigQuery bill is a query-shape problem. We cut one 72% in three weeks.

Comments 1
3 min read
Building a School Database with PostgreSQL: My SQL Week 2 Journey

Building a School Database with PostgreSQL: My SQL Week 2 Journey

1
Comments
4 min read
Consent-First AI: Build Systems You Trust

Consent-First AI: Build Systems You Trust

Comments
6 min read
Why SQL Is Still the Most Important Skill for Data Engineers

Why SQL Is Still the Most Important Skill for Data Engineers

Comments
3 min read
AI Data Lake and Lakehouse

AI Data Lake and Lakehouse

Comments
18 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.