DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Apache Data Lakehouse Weekly: July 1 to July 8, 2026
alexmercedcoder profile

Apache Data Lakehouse Weekly: July 1 to July 8, 2026

#news #data #dataengineering #opensource
Comments
24 min read
The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse
alexmercedcoder profile

The State of Apache Polaris in July 2026: From Incubating Catalog to the Governance Layer of the Open Lakehouse

#news #database #dataengineering #opensource
Comments
22 min read
The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere
alexmercedcoder profile

The State of Apache Arrow in 2026: Ten Years In, the Invisible Standard Is Everywhere

#architecture #data #dataengineering #opensource
Comments
21 min read
The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade
alexmercedcoder profile

The State of Apache Parquet in 2026: The Quiet Format Enters Its Loudest Decade

#news #data #dataengineering #opensource
Comments
21 min read
The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter
alexmercedcoder profile

The State of Apache Iceberg v4 in July 2026: What the Dev List Tells Us About the Format's Next Chapter

#news #database #dataengineering #opensource
Comments
22 min read
Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data
alexmercedcoder profile

Delete Files vs Deletion Vectors in Apache Iceberg: How V3 Rewrote the Economics of Changing Data

#architecture #database #dataengineering #performance
Comments
22 min read
Your Data Pipeline Is Probably More Fragile Than You Think
sampada_sharma_842c114249 profile

Your Data Pipeline Is Probably More Fragile Than You Think

#dataengineering #data
Comments
4 min read
OLTP vs OLAP : Understanding the Foundation of Modern Data Systems
sirsona profile

OLTP vs OLAP : Understanding the Foundation of Modern Data Systems

#architecture #database #dataengineering #systemdesign
Comments
4 min read
The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics
alexmercedcoder profile

The Variant Type in Apache Iceberg: How Shredding Turns Messy JSON Into Fast Analytics

#analytics #database #dataengineering #performance
Comments
22 min read
Designing Schema Boundaries for AI Agents
gyu07 profile

Designing Schema Boundaries for AI Agents

#ai #database #dataengineering #dbt
1
Comments
12 min read
chapter 2 of ai-assisted data engineering is live
shrouwoods profile

chapter 2 of ai-assisted data engineering is live

#ai #dataengineering #writing #books
1
Comments
4 min read
Day 66/100 - ClickHouse Keeper vs ZooKeeper: Migration and Benchmarks
kanishga_subramani_49ad73 profile

Day 66/100 - ClickHouse Keeper vs ZooKeeper: Migration and Benchmarks

#clickhouse #devops #database #dataengineering
Comments
6 min read
Debezium vs Managed CDC: How to Actually Decide Between Build and Buy
techsourabh profile

Debezium vs Managed CDC: How to Actually Decide Between Build and Buy

#dataengineering #database #cdc
Comments
9 min read
Why do I learn Apache Spark as I move from Data Analyst to Data Engineer?
ashwin_udhayakannan_2 profile

Why do I learn Apache Spark as I move from Data Analyst to Data Engineer?

#spark #dataengineering #ai #career
Comments
2 min read
I Finally Understood AWS Data Pipelines After Following a Single Customer Click
anupa_supul profile

I Finally Understood AWS Data Pipelines After Following a Single Customer Click

#architecture #aws #beginners #dataengineering
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.