Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
dataengineering
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
What AI Agents Taught Me About Building Databricks Apps
Daniel Ferraz
Daniel Ferraz
Daniel Ferraz
Follow
Oct 21
What AI Agents Taught Me About Building Databricks Apps
#
ai
#
databricks
#
dataengineering
#
softwareengineering
Comments
Add Comment
7 min read
Six things that break when a data microservice goes to production
uzie
uzie
uzie
Follow
Oct 21
Six things that break when a data microservice goes to production
#
python
#
fastapi
#
polars
#
dataengineering
Comments
Add Comment
4 min read
Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Follow
Oct 21
Every Step Runs Inside poll(): The Kafka Consumer Flow, End to End
#
kafka
#
java
#
distributedsystems
#
dataengineering
Comments
Add Comment
4 min read
Testing PySpark Data Quality in CI: A Practical Retail Media Example
Rupak Kulkarni
Rupak Kulkarni
Rupak Kulkarni
Follow
Oct 21
Testing PySpark Data Quality in CI: A Practical Retail Media Example
#
pyspark
#
dataengineering
#
testing
#
githubactions
Comments
Add Comment
5 min read
Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once
Karan Pulyala
Karan Pulyala
Karan Pulyala
Follow
Oct 21
Auto Loader and Structured Streaming on Azure Databricks: Checkpoints, Schema Evolution, and Exactly-Once
#
databricks
#
pyspark
#
dataengineering
#
azure
Comments
Add Comment
6 min read
Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Charan Reddy Rachumalla
Follow
Oct 21
Events In, Answers Out: One Pipeline From Kafka Stream to Iceberg Table
#
kafka
#
flink
#
dataengineering
#
streamprocessing
Comments
Add Comment
3 min read
I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false
Hugo.H
Hugo.H
Hugo.H
Follow
Oct 21
I found a jean at 6 euros on a 46 euro market. The deal was the easy part. published: false
#
webscraping
#
monitoring
#
dataengineering
#
automation
Comments
Add Comment
3 min read
Don't mock BigQuery, test on BigQuery: the rewrite of BigTesty
Mazlum Tosun
Mazlum Tosun
Mazlum Tosun
Follow
for
Google Developer Experts
Oct 21
Don't mock BigQuery, test on BigQuery: the rewrite of BigTesty
#
bigquery
#
googlecloud
#
dataengineering
#
testing
Comments
Add Comment
7 min read
Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.
Brian Mugo
Brian Mugo
Brian Mugo
Follow
Oct 21
Window Functions, Joins, CTEs and Subqueries in SQL: A Hospital Dataset Walkthrough.
#
sql
#
postgres
#
dataengineering
#
database
Comments
Add Comment
9 min read
DuckDB vs Spark: which workloads actually need a cluster
Mohammed Arshad Ansari
Mohammed Arshad Ansari
Mohammed Arshad Ansari
Follow
Oct 21
DuckDB vs Spark: which workloads actually need a cluster
#
dataengineering
#
database
#
python
#
data
Comments
Add Comment
3 min read
Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi
Koray Yalçın
Koray Yalçın
Koray Yalçın
Follow
Oct 21
Pazarlama olaylarını sunucuda toplamak: Bir geliştiricinin kontrol listesi
#
analytics
#
webdev
#
dataengineering
#
privacy
Comments
Add Comment
3 min read
I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them
Pangolinfo
Pangolinfo
Pangolinfo
Follow
Oct 21
I Registered Fresh Accounts on 5 Amazon Scraper APIs and Ran the Same Test on All of Them
#
webscraping
#
dataengineering
#
api
#
python
1
reaction
Comments
Add Comment
8 min read
Your BI Quote Is Really a Data Quote
Seven Billion Analytics
Seven Billion Analytics
Seven Billion Analytics
Follow
Oct 21
Your BI Quote Is Really a Data Quote
#
businessintelligence
#
dataengineering
#
analytics
#
budgeting
Comments
Add Comment
2 min read
Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts
Aniket Abhishek Soni
Aniket Abhishek Soni
Aniket Abhishek Soni
Follow
Oct 21
Faster Pip Installs in Python Docker Images With BuildKit Cache Mounts
#
docker
#
python
#
cicd
#
dataengineering
2
reactions
Comments
Add Comment
4 min read
The real work in a data agent is the harness around it
jacob baruch
jacob baruch
jacob baruch
Follow
Oct 20
The real work in a data agent is the harness around it
#
ai
#
dataengineering
#
analytics
#
data
Comments
Add Comment
6 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account