Dataengineering

👋 Sign in for the ability to sort posts by relevant, latest, or top.

ayoabass777

Apr 18

# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt

#dataengineering #kafka #dbt #postgres

6 min read

Neeraj Agarwal

Apr 18

Fabric OneLake shortcuts vs ADLS Gen2 mounts: what actually works in production

#dataengineering #azure #tutorial #microsoft

5 min read

Aditya Somani

Apr 18

A Practical Guide to Evaluating Data Warehouses for Low-Latency Analytics (2026 Edition)

#dataengineering #analytics #database #webdev

13 min read

longtk26

Apr 17

Overview: Change Data Capture (CDC)

#database #dataengineering #distributedsystems #systemdesign

4 min read

Martin Tuncaydin

Apr 17

The NDC Revolution and What It Means for Data Engineers in Travel Tech

#ndc #dataengineering #airlinetechnology #traveltech

6 min read

Hello Arisyn

Apr 17

The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool

#dataengineering #semanticlayer #datagovernance #naturallanguagequery

4 min read

Anthony Gicheru

Apr 17

Data Pipelines Explained Simply (and How to Build Them with Python)

#etl #python #datapipeline #dataengineering

2 min read

Meng Lin

Apr 16

Building NewHomie property analytics tool — Part 1

#dataengineering #aws #softwareengineering #distributedsystems

8 min read

ptimizeroracle

Apr 16

Stop Rewriting the Same LLM Boilerplate: Batch-Process DataFrames in 3 Lines

#python #opensource #dataengineering #llm

4 min read

Vignesh

Apr 17

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

#dataengineering #airflow #etl #programming

4 min read

Wilians Conde

Apr 16

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

#dataengineering #mongodb #systemdesign #bigdata

3 min read

DataDriven

Apr 16

What Spark Interviews Actually Test (Based on 189 Real Interview Reports)

#dataengineering #interview #career #programming

7 min read

Anthony Johnson II

Apr 16

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

#dataquality #semanticlayer #dataengineering #opensource

9 min read

Soumyadeep Basu

Apr 16

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

#aws #dataengineering #terraform #cloud

4 min read

XIANGWEIXIAO

Apr 16

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance

#database #dataengineering #performance #sql

5 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.

DEV Community

# dataengineering

# Building a Streaming Session Analytics Pipeline with Kafka, Postgres, and dbt

Fabric OneLake shortcuts vs ADLS Gen2 mounts: what actually works in production

A Practical Guide to Evaluating Data Warehouses for Low-Latency Analytics (2026 Edition)

Overview: Change Data Capture (CDC)

The NDC Revolution and What It Means for Data Engineers in Travel Tech

The Missing Layer in Your Data Stack Why Semantic Intelligence Matters More Than Another BI Tool

Data Pipelines Explained Simply (and How to Build Them with Python)

Building NewHomie property analytics tool — Part 1

Stop Rewriting the Same LLM Boilerplate: Batch-Process DataFrames in 3 Lines

How to Add a Data Quality Gate to Your Airflow Pipeline in 5 Minutes

Processing High Frequency Solar Data Without HPC: Real Constraints and Design Decisions in MackSun

What Spark Interviews Actually Test (Based on 189 Real Interview Reports)

Why Semantic Layers Need Distributional Validation, Not Just Schema Validation

AWS Lake Formation: TBAC vs NBAC — The Permission Model Decision That Will Define Your Data Lake

DuckDB in the Wild: What 6 Minutes of Benchmarking Across 4 Machines Taught Me About Real-World Performance