DEV Community

#dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Building a Medallion Data Warehouse with Airflow, dbt, and PostgreSQL — and the 3 Bugs That Taught Me the Most

Building a Medallion Data Warehouse with Airflow, dbt, and PostgreSQL — and the 3 Bugs That Taught Me the Most

Comments
3 min read
I built a free Data Engineering pipeline with dbt, DuckDB and GitHub Actions (no AWS)

I built a free Data Engineering pipeline with dbt, DuckDB and GitHub Actions (no AWS)

4
Comments 1
7 min read
Inspecting Apache Parquet Footers & Debugging MCP (mcp.json) Configs Entirely In-Browser

Inspecting Apache Parquet Footers & Debugging MCP (mcp.json) Configs Entirely In-Browser

Comments 2
3 min read
An Aggregate Is a Function, Not a Sum

An Aggregate Is a Function, Not a Sum

Comments
18 min read
Airbyte vs Estuary for Postgres to Snowflake Replication

Airbyte vs Estuary for Postgres to Snowflake Replication

Comments
6 min read
ClickHouse Cloud Executable UDFs GA: Native Code, Network Access, and Query-Level Metrics

ClickHouse Cloud Executable UDFs GA: Native Code, Network Access, and Query-Level Metrics

Comments
3 min read
Snowflake's AI Agents Fix Pipelines: Data Engineer Impact

Snowflake's AI Agents Fix Pipelines: Data Engineer Impact

Comments
9 min read
Building a subcontractor shortlist for a federal machining bid from SBA Small Business Search with Python

Building a subcontractor shortlist for a federal machining bid from SBA Small Business Search with Python

Comments
5 min read
DAX in eMondrian is out of beta: what works in Power BI, and what doesn't

DAX in eMondrian is out of beta: what works in Power BI, and what doesn't

Comments
5 min read
Parquet vs Avro vs ORC for Data Engineering

Parquet vs Avro vs ORC for Data Engineering

Comments
8 min read
Beyond Sentiment: Customer Intelligence with Snowflake Cortex AI and Streamlit

Beyond Sentiment: Customer Intelligence with Snowflake Cortex AI and Streamlit

Comments
8 min read
Free company data API: four endpoints with no key — and the four traps that corrupt your dataset

Free company data API: four endpoints with no key — and the four traps that corrupt your dataset

Comments
10 min read
Postgres to Snowflake with CDC: Open Source, No Kafka, No Stage

Postgres to Snowflake with CDC: Open Source, No Kafka, No Stage

Comments
10 min read
10 SQL Interview Questions for Data Engineers (2027), with Answers

10 SQL Interview Questions for Data Engineers (2027), with Answers

Comments
7 min read
Crestline Supply on a whiteboard: five drawings, no AWS required

Crestline Supply on a whiteboard: five drawings, no AWS required

Comments
9 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.