Framework Libraries Used in Web Scraping

go

---

ferret

5,663 v0.18.0 (1 year, 3 months ago) Aug 06 2019

gocrawl

2,029 (3 years ago) Nov 20 2016

dataflowkit

651 2024-06-25 (20 days ago) Feb 09 2017

geziyor

2,488 2024-05-09 (2 months ago) Jun 06 2019

pholcus

7,554 v1.3.4 (4 years ago) Feb 15 2020

colly

22,459 v2.1.0 (4 years ago) May 14 2018

javascript

---

ayakashi

200 1.0.0-beta8.4 (1 year, 17 days ago) Apr 18 2019

node-crawler

6,650 2.0.1 (20 days ago) Sep 10 2012

php

---

crwlr-crawler

311 v1.9.3 (10 days ago) Apr 18 2022

php-spider

1,328 v0.7.2 (7 months ago) Mar 16 2013

phpscraper

506 3.0.0 (3 months ago) May 04 2020

roach

1,337 v3.2.0 (3 months ago) Dec 27 2021

panther

2,907 v2.1.1 (7 months ago) Jul 17 2018

python

---

dude

413 0.1.3 (11 months ago) Feb 20 2022

photon

10,672 1.1.9 (5 years ago) Aug 24 2018

ruia

1,737 0.8.5 (1 year, 10 months ago) Oct 17 2018

gerapy

3,257 0.9.13 (11 months ago) Jul 04 2017

gracy

240 1.33.0 (4 months ago) Feb 05 2023

scrapydweb

3,048 1.5.0 (5 months ago) Sep 30 2018

autoscraper

6,060 1.1.14 (1 year, 11 months ago) Jul 26 2019

scrapyd

2,884 1.4.3 (9 months ago) Sep 04 2013

scrapy

51,636 2.11.2 (2 months ago) Jul 26 2019

r

---

ralger

153 2.2.4 (3 years ago) Dec 22 2019

rvest

1,485 1.0.4 (1 year, 10 months ago) Nov 22 2014

ruby

---

wombat

1,308 3.0.0 (1 year, 10 months ago) Dec 27 2011

spidr

795 0.7.1 (5 months ago) Jul 25 2009