DEV Community

Aniket Abhishek Soni profile picture

Aniket Abhishek Soni

Senior Data Engineer at Cognizant with 7+ years in ETL pipelines, AI-driven analytics, and cloud-native systems (Databricks, PySpark, Snowflake, AWS). Writing about data engineering, AI & cloud.

Location Brooklyn, New York, United States of America Joined Joined on  Personal website https://aniketsoni.com

Education

MS Computer Science - Southern Arkansas University

Pronouns

He/Him/His

Work

Senior Data Engineer at Cognizant Technology Solutions

Text-to-SQL is a solved problem: why you’re about to leak your PII
aniketsoni profile

Text-to-SQL is a solved problem: why you’re about to leak your PII

#sql #llm #security #data
Comments
5 min read
Time Travel isn't a Debugging Luxury: Why Delta and Iceberg are Compliance Essentials
aniketsoni profile

Time Travel isn't a Debugging Luxury: Why Delta and Iceberg are Compliance Essentials

#data #engineering #iceberg #delta
Comments
4 min read
Is BigLake the End of Your Vendor Lock-in Delusion?
aniketsoni profile

Is BigLake the End of Your Vendor Lock-in Delusion?

#gcp #bigquery #iceberg #dataengineering
Comments
5 min read
Querying Petabytes of Iceberg Tables via BigLake without Breaking Production
aniketsoni profile

Querying Petabytes of Iceberg Tables via BigLake without Breaking Production

#dataengineering #gcp #iceberg #bigquery
Comments
4 min read
Why I’m finally ditching Hive Metastore for BigLake Iceberg
aniketsoni profile

Why I’m finally ditching Hive Metastore for BigLake Iceberg

#gcp #iceberg #bigquery #dataengineering
Comments
5 min read
How I Finally Killed the Full-Refresh Silver Layer
aniketsoni profile

How I Finally Killed the Full-Refresh Silver Layer

#delta #databricks #spark #dataengineering
Comments
5 min read
Cutting Snowflake compute costs 40 percent: warehouse sizing, auto-suspend, and query pruning
aniketsoni profile

Cutting Snowflake compute costs 40 percent: warehouse sizing, auto-suspend, and query pruning

#snowflake #cloud #data #engineering
Comments
5 min read
Streaming Tables vs. Materialized Views: Stop Guessing Your Databricks Refresh Strategy
aniketsoni profile

Streaming Tables vs. Materialized Views: Stop Guessing Your Databricks Refresh Strategy

#databricks #dataengineering #spark #delta
Comments
5 min read
Stop Burning Cash: Databricks Cost Optimization Patterns That Actually Work
aniketsoni profile

Stop Burning Cash: Databricks Cost Optimization Patterns That Actually Work

#databricks #cloud #finops #dataengineering
Comments
5 min read
Navigating Schema Shifts: Keeping Your Streaming Pipeline Smooth for Everyone
aniketsoni profile

Navigating Schema Shifts: Keeping Your Streaming Pipeline Smooth for Everyone

#streaming #schema #data #engineering
Comments
4 min read
The Silent Killer in Your Streaming Pipeline: Schema Evolution Without Tears
aniketsoni profile

The Silent Killer in Your Streaming Pipeline: Schema Evolution Without Tears

#schema #streaming #datapipelines #production
Comments
10 min read
Zero to Hardened: A Practical Migration Playbook for Docker Hardened Images in Regulated Industries
aniketsoni profile

Zero to Hardened: A Practical Migration Playbook for Docker Hardened Images in Regulated Industries

#docker #security #devops #containers
Comments
7 min read
It Works on My Cluster: Containerizing Spark and Lakehouse Development with Docker
aniketsoni profile

It Works on My Cluster: Containerizing Spark and Lakehouse Development with Docker

#docker #dataengineering #spark #devops
Comments
7 min read
Biohack Your Brain with Neural Implants: Why Silicon Valley's Elite Are Betting Big in 2026
aniketsoni profile

Biohack Your Brain with Neural Implants: Why Silicon Valley's Elite Are Betting Big in 2026

#ai #neuroscience #technology #future
Comments
5 min read
loading...