DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction
alterlab profile

Replacing Fragile CSS Selectors with LLM-Powered Zero-Shot JSON Extraction

#webscraping #aiagents #llm #python
Comments
8 min read
Querying Germany's Company Register via API: Clean JSON and the new eGbR
pat198707 profile

Querying Germany's Company Register via API: Clean JSON and the new eGbR

#api #data #dataengineering #webscraping
Comments
1 min read
Best AI Web Scraping Tools in 2026: How to Choose
tonywangca profile

Best AI Web Scraping Tools in 2026: How to Choose

#ai #tutorial #webscraping
Comments
9 min read
How to Build a Threads Scraper for Meta Profiles and Posts
odeeb profile

How to Build a Threads Scraper for Meta Profiles and Posts

#api #webscraping #socialmedia #datascience
Comments
6 min read
How to Build a LinkedIn Profile Scraper: The Honest Technical Guide
odeeb profile

How to Build a LinkedIn Profile Scraper: The Honest Technical Guide

#api #webscraping #datascience #leadgen
Comments
7 min read
Building a Resilient Instagram Scraper With Selenium — What Mimicking Human Behavior Actually Looks Like
tsvetang2 profile

Building a Resilient Instagram Scraper With Selenium — What Mimicking Human Behavior Actually Looks Like

#python #selenium #automation #webscraping
Comments
3 min read
How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)
perufitlife profile

How to Scrape the Facebook Ad Library for Competitor Ad Intelligence (No Login)

#webscraping #marketing #facebook #ai
Comments
3 min read
How to Scrape Public Telegram Channels Without the API, Login, or MTProto
perufitlife profile

How to Scrape Public Telegram Channels Without the API, Login, or MTProto

#webscraping #telegram #javascript #osint
Comments
3 min read
Build a Healthcare Lead List From the Public NPI Registry (NPPES API)
perufitlife profile

Build a Healthcare Lead List From the Public NPI Registry (NPPES API)

#webscraping #leadgeneration #healthcare #api
Comments
3 min read
How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth
proxyvero profile

How We Optimized a Django Playwright Scraper to Save 60% on Rotating Proxy Bandwidth

#python #django #webscraping #playwright
Comments
4 min read
Building a Lean, Single-Worker Broken URL Monitor for Data Pipelines
datawinder profile

Building a Lean, Single-Worker Broken URL Monitor for Data Pipelines

#webscraping #datapipeline #devtools #apify
Comments
6 min read
How Paywalls Actually Work: The Engineering Behind Them
tonywangca profile

How Paywalls Actually Work: The Engineering Behind Them

#webscraping #seo #webdev #tutorial
2
Comments
14 min read
Why Cloudflare Breaks Proxy-Only Scrapers
anakin_writers profile

Why Cloudflare Breaks Proxy-Only Scrapers

#webscraping #cloudflare #python #automation
Comments
4 min read
How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it
sami_8858131362756585e4f4 profile
Sami

How to track Weibo hot-search velocity with Python in 2026 — the trending-delta problem and how to handle it

#python #webscraping #datascience #china
Comments
4 min read
How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs
alterlab profile

How to Scrape E-Commerce Sites for AI Agents Using Playwright and LLMs

#webscraping #aiagents #playwright #llm
Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.