DEV Community

# dataengineering

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Stop flattening your JSON just to export it to Excel

Stop flattening your JSON just to export it to Excel

Comments
2 min read
Azure Data Factory

Azure Data Factory

5
Comments
1 min read
Amazon Redshift Data Warehousing (Sample Project)

Amazon Redshift Data Warehousing (Sample Project)

Comments
2 min read
Software and Data Engineering: How They Power AI and Big Data

Software and Data Engineering: How They Power AI and Big Data

Comments
4 min read
OLAP vs OLTP: The war that is not meant to be

OLAP vs OLTP: The war that is not meant to be

Comments
2 min read
Received request api key METADATA with version 6 which is not enabled

Received request api key METADATA with version 6 which is not enabled

1
Comments
1 min read
Personal Picks: Data Product News (March 19, 2025)

Personal Picks: Data Product News (March 19, 2025)

Comments
5 min read
Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

Calculate a Pair of Minimum Values that Meet the Criteria within the Group — From SQL to SPL #12

6
Comments 1
2 min read
Unlocking the Power of Delta Lake UNIFORM in Databricks

Unlocking the Power of Delta Lake UNIFORM in Databricks

1
Comments
5 min read
SQLite Database GUI Tool | Design and Visualize with DbSchema

SQLite Database GUI Tool | Design and Visualize with DbSchema

4
Comments
4 min read
Databricks Optimistic Concurrency Control: Enabling Efficient Collaboration in Big Data Environments

Databricks Optimistic Concurrency Control: Enabling Efficient Collaboration in Big Data Environments

1
Comments
5 min read
Why Pi-Shaped Teams Matter in This AI Era

Why Pi-Shaped Teams Matter in This AI Era

Comments
5 min read
How to Build a Career in Data Science: A Step-by-Step Guide

How to Build a Career in Data Science: A Step-by-Step Guide

Comments
3 min read
Data architecture stack

Data architecture stack

Comments
1 min read
[Snowflake's New Feature] Alert on New Data, and try with Monitoring Tasks and Dynamic Tables

[Snowflake's New Feature] Alert on New Data, and try with Monitoring Tasks and Dynamic Tables

Comments
7 min read
Study Notes 6.15: Kafka & Flink Streaming

Study Notes 6.15: Kafka & Flink Streaming

Comments
5 min read
Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

Study Notes 6.13-14: Kafka Streaming with Python & PySpark Structured Streaming with Kafka

Comments
7 min read
Study Notes 6.11-12: Kafka ksqlDB, Connect & Schema Registry

Study Notes 6.11-12: Kafka ksqlDB, Connect & Schema Registry

Comments
7 min read
Study Notes 6.7-10: Kafka Stream Basics, JOIN, Testing & Windowing

Study Notes 6.7-10: Kafka Stream Basics, JOIN, Testing & Windowing

Comments
13 min read
Study Notes 6.3-4: What is Kafka & Confluent Cloud

Study Notes 6.3-4: What is Kafka & Confluent Cloud

Comments
6 min read
Study Notes 6.5-6: Kafka Producer, Consumer & Configuration

Study Notes 6.5-6: Kafka Producer, Consumer & Configuration

Comments
7 min read
Study Notes 6.1-2: Introduction to Stream Processing

Study Notes 6.1-2: Introduction to Stream Processing

Comments
3 min read
Calculate the Hierarchy of Recursive References — From SQL to SPL #11

Calculate the Hierarchy of Recursive References — From SQL to SPL #11

5
Comments 1
2 min read
Real-Time Data Processing with PyFlink and Redpanda

Real-Time Data Processing with PyFlink and Redpanda

Comments
1 min read
🚀 SQL Query Optimization in 2025: 7 Techniques for Faster Performance

🚀 SQL Query Optimization in 2025: 7 Techniques for Faster Performance

Comments
1 min read
loading...