DEV Community

#etl

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Why Sequential Reads Beat Random Reads in Postgres at Scale

Why Sequential Reads Beat Random Reads in Postgres at Scale

1
Comments 1
3 min read
I Thought My Virtual Environment Was Broken... It Wasn't.

I Thought My Virtual Environment Was Broken... It Wasn't.

Comments
1 min read
Understanding ETL: A Chaotic Introduction

Understanding ETL: A Chaotic Introduction

Comments
4 min read
schema drift를 fail이 아니라 warn으로 둔 이유

schema drift를 fail이 아니라 warn으로 둔 이유

Comments
2 min read
skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

skip에서 partition overwrite로: business_date 재처리를 Iceberg로 다시 표현하기

Comments
3 min read
source_hash로 같은 입력 재처리를 안전하게 skip하기

source_hash로 같은 입력 재처리를 안전하게 skip하기

Comments
1 min read
wide CSV 여러 개를 EAV로 모아 gold mart 만들기

wide CSV 여러 개를 EAV로 모아 gold mart 만들기

Comments
2 min read
AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

AI for Data Pipelines & ETL in 2026: dbt AI vs Airflow vs Prefect vs Fivetran

Comments
6 min read
Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Building My First End-to-End ETL Pipeline with Airflow, BigQuery, and Docker

Comments
2 min read
Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Why Metadata-Driven ETL Frameworks Scale Better Than Hardcoded Pipelines — and Where They Don't

Comments
2 min read
From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase

From Clean Data to BI-Ready Reporting Tables with Python, PostgreSQL, and Metabase

1
Comments
9 min read
# go-intake: Go-Native Streaming Data Ingestion Toolkit

# go-intake: Go-Native Streaming Data Ingestion Toolkit

Comments
3 min read
From Data Quality Checks to Analytics-Ready Parquet with Python

From Data Quality Checks to Analytics-Ready Parquet with Python

1
Comments
8 min read
Extract data from Databases into DuckLake

Extract data from Databases into DuckLake

Comments
4 min read
ETL Pipeline: Fetching Real-Time News Data with Python and Postgres

ETL Pipeline: Fetching Real-Time News Data with Python and Postgres

1
Comments
4 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.