Skip to content

Web Scrapers

Ready-to-use, open source web scrapers for popular websites. Each scraper is a complete Python project with examples, tests, and sample output data.

All scrapers are built with Python and use Scrapfly for reliable data collection - handling anti-bot bypass, JavaScript rendering, and proxy rotation automatically.

Looking for a scraping API?

If you don't want to build and maintain your own scrapers, consider using a web scraping API service. See Scrapeway's benchmarks for an independent comparison of the best web scraping APIs, updated every two weeks.

By Category

E-Commerce & Shopping

Target What You Can Scrape Anti-Bot
Amazon products, search results, reviews, pricing CloudFront WAF
Walmart products, search results, reviews PerimeterX
eBay products, search results, seller info -
Etsy products, shops, search results Datadome
AliExpress products, search results, reviews -
Best Buy products, search results, reviews, promos -
StockX products, pricing, market data PerimeterX
Nordstrom products, search results -
Goat products, pricing -
Fashionphile products, luxury items -
Vestiaire Collective products, luxury resale -

Real Estate

Target What You Can Scrape Anti-Bot
Zillow listings, property details, search results PerimeterX
Realtor.com listings, property details, agents Kasada
Redfin listings, property details, market data -
Zoopla UK listings, property details -
Rightmove UK listings, property details -
Realestatecom AU listings, property details -
Idealista ES/PT/IT listings -
ImmobilienScout24 DE listings -
Immowelt DE listings -
Homegate CH listings -
SeLoger FR listings -
Leboncoin FR listings, classifieds -

Social Media

Target What You Can Scrape Anti-Bot
Instagram profiles, posts, reels, stories Yes
TikTok profiles, videos, comments Yes
Twitter/X profiles, tweets, search Yes
Reddit posts, comments, subreddits -
Threads profiles, posts Yes
YouTube videos, channels, comments, search -

Jobs & Business

Target What You Can Scrape Anti-Bot
LinkedIn profiles, companies, jobs, articles Arkoselabs
Indeed job listings, search results Cloudflare
Glassdoor reviews, salaries, job listings -
Wellfound startup jobs, company profiles -
ZoomInfo company data, contacts -
Crunchbase companies, investors, funding -
G2 software reviews, comparisons -

Reviews & Local

Target What You Can Scrape Anti-Bot
Trustpilot company reviews, ratings -
Yelp businesses, reviews, search -
YellowPages business listings -
TripAdvisor hotels, restaurants, reviews -

Travel

Target What You Can Scrape Anti-Bot
Booking.com hotels, search results, prices Yes

Search Engines

Target What You Can Scrape Anti-Bot
Google search results, maps, SEO data Yes
Bing search results, keywords -

Other

Target What You Can Scrape Anti-Bot
SimilarWeb website traffic, analytics -
Domain.com domain info -
Allegro PL e-commerce, products -

Using a Web Scraping API

Building and maintaining scrapers is time-consuming - anti-bot systems change frequently and proxy infrastructure is expensive to run. Web scraping APIs handle all of this for you.

Scrapeway independently benchmarks the top web scraping APIs every two weeks. Here are the current leaders:

Rank Service Success Rate Speed Cost/1000
1 Scrapfly 99% 6.6s $4.05
2 WebScrapingAPI 85% 16.5s $2.71
3 Firecrawl 64% 4.1s $5.15

See the full Scrapeway benchmark results for detailed breakdowns by target website.

All scrapers are open source and available on GitHub: scrapfly/scrapfly-scrapers

Was this page helpful?