DEV Community

Aki profile picture

Aki

12× AWS‑Certified • AWS Community Builder (Data) Engineer specializing in cloud and data platforms, focusing on serverless ETL and modern lakehouse architectures.

Location Japan Joined Joined on  Personal website https://zenn.dev/penginpenguin github website twitter website
Optimizing Data Processing on AWS with Data Compaction
datapenguin profile

Optimizing Data Processing on AWS with Data Compaction

#aws #dataengineering #iceberg #lambda
2
Comments
7 min read

Want to connect with Aki?

Create an account to connect with Aki. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Designing a Cost-Efficient Parallel Data Pipeline on AWS Using Lambda and SQS
datapenguin profile

Designing a Cost-Efficient Parallel Data Pipeline on AWS Using Lambda and SQS

#aws #dataengineering #lambda #sqs
1
Comments
6 min read
Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)
datapenguin profile

Interoperating Open Table Formats on AWS Using Apache XTable (Delta Iceberg)

#aws #iceberg #deltalake #dataengineering
4
Comments
4 min read
Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Dynamic Routing Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #dataengineering #duckdb #iceberg
6
Comments 4
4 min read
Lightweight ETL with AWS Lambda, DuckDB, and delta-rs
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and delta-rs

#aws #dataengineering #delta
4
Comments
5 min read
Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Lambda, DuckDB, and PyIceberg

#aws #duckdb #iceberg #dataengineering
5
Comments
4 min read
Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena
datapenguin profile

Build a Lightweight Serverless ETL Pipeline to Iceberg Tables with AWS Lambda Athena

#aws #iceberg #dataengineering
2
Comments
4 min read
PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods
datapenguin profile

PyIceberg on AWS Lambda: Comparing GlueCatalog and REST Catalog Access Methods

#aws #iceberg #dataengineering
2
Comments
3 min read
Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg
datapenguin profile

Lightweight ETL with AWS Glue Python Shell, DuckDB, and PyIceberg

#aws #iceberg #dataengineering #duckdb
3
Comments 1
7 min read
AWS IP Range Lookup Tool for Quick Security Checks
datapenguin profile

AWS IP Range Lookup Tool for Quick Security Checks

#aws
2
Comments
5 min read
Building a CLI Tool to Visualize AWS Iceberg Table Snapshot History
datapenguin profile

Building a CLI Tool to Visualize AWS Iceberg Table Snapshot History

#aws #iceberg #opensource
5
Comments
7 min read
loading...