DEV Community

Lorenzo Tenti
Lorenzo Tenti

Posted on

Big Data is dead & other stories

This article originally appeared on ingest this!, a curated newsletter about Data Engineering, MLOps, and Machine Learning Engineering.


Read this πŸ“š

Big Data is Dead

single machines are capable of processing a much greater percentage of workloads as time goes on and technology advances

In this article, Jordan Tigani challenges the idea that big data is necessary for analytics and argues that it’s mainly a result of poor data management practices. The article explains that big data solutions are often overkill for most analytics workloads and that they incur high costs and complexity. In addition, he suggests that modern hardware advancements have made it possible to process large amounts of data on a single machine without the need for distributed computing.


Learn this πŸ§‘πŸ»β€πŸ«

Prompt Engineering Guide

Prompt engineering is a hot topic these days, thanks to the rise of large language models (did you catch that?). This guide has everything you need to get started: recent papers, tutorials, videos, links and tools.


Watch this πŸ‘€

Advanced Design Patterns for DynamoDB

The first time I watched this talk, I found it mind-blowing. Rick Houlihan reveals the common misconceptions about NoSQL database services. I used to think NoSQL was great for its flexibility, but the opposite is often true. Even if he focuses on DynamoDB, the concepts explained in the talk (single-table design and using composite keys to support different access patterns) can be applied to many other services. Definitely a must-watch.


Hack this πŸ› οΈ

There's an AI for that

This website, by Andrei, is a curated list of products offering AI-based solutions to any kind of problem.

Disclaimer: this is not an invite to literally hack the website but only to have fun with one of the tools you’ll find there.


Meme this πŸš€

meme this!


This article originally appeared on ingest this!, a curated newsletter about Data Engineering, MLOps, and Machine Learning Engineering.

Top comments (0)