Dataengineering

Alex Merced

Oct 31

Hands-on with Apache Iceberg & Dremio on Your Laptop within 10 Minutes

#database #datascience #dataengineering #dataanalytics

19 min read

Aditya Pratap Bhuyan

Oct 31

Mastering Workflow Automation with Apache Airflow for Data Engineering

#dataengineering #apacheairflow

6 min read

Alex Merced

Oct 30

Data Modeling - Entities and Events

#database #dataengineering #datamodeling #dataanalytics

6 min read

Geazi Anc

Oct 28

Análise de dados de tráfego aéreo em tempo real com Spark Structured Streaming e Apache Kafka

#dataengineering #python #braziliandevs #spark

8 min read

Paulet Wairagu

Oct 26

My journey learning Apache Spark

#spark #sql #dataengineering

2 min read

Danwycliff Ndwiga

Oct 30

SQL "SELECT INTO" vs "INSERT INTO SELECT" statements.

#sql #database #data #dataengineering

1 min read

Lusanda Ndlovu

Oct 20

My Journey into Data AI and Machine Learning

#softwaredevelopment #ai #machinelearning #dataengineering

1 min read

Lulu Cheng for jarrid.xyz

Oct 15

Why Data Security is Broken and How to Fix it?

#security #automation #devops #dataengineering

1

5 min read

luminousmen

Oct 15

From ETL and ELT to Reverse ETL

#dataengineering #bigdata #data

4 min read

Rodolfo Mendivil

Oct 18

Mastering Informatica Intelligent Cloud Services (IICS) for Cloud Data Integration

#iics #data #etl #dataengineering

1

3 min read

Abdullah Haggag

Oct 17

Building a Big Data Playground Sandbox for Learning

#dataengineering #bigdata #opensource

4

5 min read

Norton Augusto Herrero dos Santos

Oct 12

What is Data Engineering?

#dataengineering #datascience

1 min read

Pavol Z. Kutaj

Oct 14

Explaining the History of Data Lakehouse

#lakehouse #dataengineering #warehouse

2 min read

abdulmaleek mubaraq

Oct 8

End-to-End ETL and Sales Dashboard on WWI dataset in Microsoft Fabric

#tutorial #dataengineering #devto #analytics

7 min read

Alex Merced

Oct 21

All About Parquet Part 01 - An Introduction

#database #dataengineering

4 min read

Alex Merced

Oct 21

All About Parquet Part 09 - Parquet in Data Lake Architectures

#data #database #datascience #dataengineering

5 min read

Alex Merced

Oct 21

All About Parquet Part 02 - Parquet's Columnar Storage Model

#database #datascience #dataengineering

4 min read

Alex Merced

Oct 21

All About Parquet Part 10 - Performance Tuning and Best Practices with Parquet

#database #datascience #dataengineering

6 min read

Alex Merced

Oct 21

All About Parquet Part 06 - Encoding in Parquet | Optimizing for Storage

#database #datascience #dataengineering

6 min read

Alex Merced

Oct 21

All About Parquet Part 08 - Reading and Writing Parquet Files in Python

#database #datascience #dataengineering #data

5 min read

Milcah03

Oct 7

Data Analysis: The Unsung Hero of Modern Business

#datascience #dataengineering #writing #datastructures

2 min read

prakhyatkarri

Oct 20

From a Unified Bronze Layer to Multiple Silver Layers: Streamlining Data Transformation in Databricks Unity Catalog

#databricks #unitycatalog #medallionarchitecture #dataengineering

1

5 min read

Raj Tiwari

Oct 7

Analyzing Airbnb Listings in Chicago: A Power BI Dashboard Project

#datascience #dataengineering #data

1

4 min read

Sourabh Gupta

Oct 28

5 Best ETL Tools: A Comprehensive Comparison Guide

#etl #datascience #dataengineering #learning

1

3 min read

Geazi Anc

Oct 18

Data Engineering with Scala: Mastering Real-Time Data Processing with Apache Flink and Google Pub/Sub

#dataengineering #scala #datascience #flink

1

15 min read

Sajjad Rahman

Oct 24

AWS DATA ENGINEER - 101

#aws #dataengineering #awschallenge #awsbigdata

2

2 min read

Abdullah Haggag

Oct 24

The Journey From a CSV File to Apache Hive Table

#hadoop #hive #bigdata #dataengineering

6

6 min read

luminousmen

Sep 29

Why Apache Spark RDD is immutable?

#dataengineering #bigdata #data

3 min read

Alex Merced

Oct 21

All About Parquet Part 04 - Schema Evolution in Parquet

#database #datascience #dataengineering

1

5 min read

Emmanuel Awa

Sep 26

Data Engineering in Observability: The Backbone of Modern Monitoring

#dataengineering #observability #opensource #banking

1

5 min read

Sourabh Gupta

Oct 28

Oracle to Snowflake Migration: Steps, Challenges & Best Practices

#datascience #dataengineering #tutorial #learning

1

3 min read

MissMati

Oct 27

Data Engineering in 2024: Innovations and Trends Shaping the Future

#dataengineering #data #analytics

4

1

13 min read

Gustavo

Sep 19

Achieving Clean and Scalable PySpark Code: A Guide to Avoiding Redundancy

#pyspark #dataengineering #cleancode #python

5 min read

Pavol Z. Kutaj

Oct 11

Explaining CDC (Change Data Capture)

#databricks #dataengineering

1 min read

Pablo Arango Ramirez

Oct 22

Capítulo 2 - Modelos de Datos y Lenguajes de Consulta

#data #sql #nosql #dataengineering

2

8 min read

Alex Merced

Oct 21

All About Parquet Part 05 - Compression Techniques in Parquet

#database #datascience #dataengineering

1

5 min read

Alex Merced

Oct 21

All About Parquet Part 07 - Metadata in Parquet | Improving Data Efficiency

#data #database #dataengineering #datascience

1

5 min read

Alex Merced

Oct 21

All About Parquet Part 03 - Parquet File Structure | Pages, Row Groups, and Columns

#database #datascience #dataengineering

1

5 min read

Regnard Raquedan

Sep 13

Clear Link Between DevSecOps and Data Engineering

#dataengineering #devops #devsecops #cloud

1 min read

Farah Kim

Oct 17

Still Using SQL, Python, & Excel for Data Deduplication? Here's Why You Need Better Tools.

#algorithms #ai #dataengineering

5

4 min read

Dendi Handian

Sep 12

Capture Browser XHR/Fetch API Response Automatically into JSON Files

#help #dataengineering #chrome #javascript

1 min read

Mark Yu

Oct 16

The True Cost of Poor Data Quality: Why It Matters and How to Improve It

#database #datascience #dataengineering #management

3

6 min read

Marco Porracin

Sep 8

Building a User-Friendly, Budget-Friendly Alternative to dbt Cloud

#dbt #dataengineering #opensource #datascience

1 min read

Norton Augusto Herrero dos Santos

Oct 12

O que é Engenharia de Dados?

#dataengineering #datascience

3

1 min read

Nuthan Kishore

Sep 7

How SQL Spatial Data Solves Real-World Problems

#firstpost #spatialdata #dataengineering

6 min read

Stephen

Sep 20

Working with Gigantic Google BigQuery Partitioned Tables in DBT

#bigquery #dbt #dataengineering #googlecloud

1

3 min read

allan-pg

Oct 10

Handling Outliers 101: Why the IQR Method is Your Go-To Tool

#python #datascience #dataengineering #data

2

3 min read

Nico Bistolfi

Oct 9

Go vs Python for File Processing: A Performance and Architecture Perspective

#python #go #performance #dataengineering

2

5 min read

Alex Merced

Oct 7

Exploring Data Operations with PySpark, Pandas, DuckDB, Polars, and DataFusion in a Python Notebook

#python #database #datascience #dataengineering

2

13 min read

Lulu Cheng for jarrid.xyz

Sep 3

Secure Data Stack: Navigating Adoption Challenges of Data Encryption

#security #dataengineering #encryption #infosec

1

5 min read

Gichuki Edwin

Oct 7

Python 101: Introduction to Python as a Data Analytics Tool

#python #analytics #datascience #dataengineering

3 min read

Alex Merced

Oct 5

Ultimate Directory of Apache Iceberg Resources

#database #dataengineering #datascience #elasticsearch

14 min read

Chetan Gupta

Oct 4

Understanding OLTP and Choosing the Right Database

#dataengineering #mongodb #postgressql #mysql

1

6 min read

Alex Merced

Oct 4

Change Data Capture (CDC) when there is no CDC

#database #dataengineering #postgres

11 min read

Milcah

Aug 27

The Ultimate Guide to Data Engineering

#dataengineering #data

2 min read

Apache Doris

Aug 27

Evolution of Data Sharding Towards Automation and Flexibility

#opensource #dataengineering #database #automation

15 min read

Chetan Gupta

Sep 29

Data Showdown: OLAP vs. OLTP – The Battle of Real-Time and Analytics Titans

#bigdata #dataengineering #understanding #database

5 min read

ismail courr

Sep 8

The Power of Data Analytics – Transforming Businesses with Insights

#dataengineering #datascience #startup

5 min read

Olga Shabalina for AWS Community Builders

Sep 28

Serverless PDF Processing with AWS Lambda and Textract

#cloudcomputing #serverless #lambda #dataengineering

9

1

9 min read

Aram Panasenco

Sep 25

The Simplest Data Architecture

#data #architecture #dataengineering #analytics

1

21 min read