DEV Community

Crawlee

Build reliable crawlers fast.

Crawlee is a web scraping and browser automation library. It helps you build reliable crawlers. Fast.

Location The interweb Joined Joined on  Twitter logo GitHub logo External link icon
Support email

support@apify.com

12 tips on how to think like a web scraping expert

12 tips on how to think like a web scraping expert

18
Comments
10 min read
How to create a LinkedIn job scraper in Python with Crawlee

How to create a LinkedIn job scraper in Python with Crawlee

64
Comments 11
6 min read
Optimizing web scraping: Scraping auth data using JSDOM

Optimizing web scraping: Scraping auth data using JSDOM

7
Comments
6 min read
Web scraping of a dynamic website using Python with HTTP Client

Web scraping of a dynamic website using Python with HTTP Client

5
Comments
12 min read
How to scrape infinite scrolling webpages with Python

How to scrape infinite scrolling webpages with Python

11
Comments
6 min read
Current problems and mistakes of web scraping in Python and tricks to solve them!

Current problems and mistakes of web scraping in Python and tricks to solve them!

10
Comments
13 min read
Announcing Crawlee Python: Now you can use Python to build reliable web crawlers

Announcing Crawlee Python: Now you can use Python to build reliable web crawlers

14
Comments
4 min read
How Crawlee uses tiered proxies to avoid getting blocked

How Crawlee uses tiered proxies to avoid getting blocked

11
Comments 1
4 min read
loading...