gerapy

python frameworkguiscrapy

3,257 4 67 MIT

0.9.13 (19 Jul 2023) Jul 04 2017 513 (month)

---

Gerapy is a Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js.

It is built on top of the Scrapy framework and provides a simple and easy-to-use interface for performing web scraping tasks. Gerapy also includes features such as support for scheduling and distributed crawling, as well as a built-in web-based dashboard for monitoring and managing scraping tasks. Additionally, Gerapy is designed to be highly extensible, allowing users to easily create custom plugins and integrations.

Overall, Gerapy is a useful tool for those looking to automate web scraping tasks and extract data from websites.

Alternatives / Similar

---

scrapydweb

3,048 1.5.0 (5 months ago) Sep 30 2018 compare

scrapy

51,636 2.11.2 (2 months ago) Jul 26 2019 compare

scrapyd

2,884 1.4.3 (9 months ago) Sep 04 2013 compare

autoscraper

6,060 1.1.14 (1 year, 11 months ago) Jul 26 2019 compare

gracy

240 1.33.0 (4 months ago) Feb 05 2023 compare

ruia

1,737 0.8.5 (1 year, 10 months ago) Oct 17 2018 compare

splash

4,039 3.5 (4 years ago) Apr 25 2014 compare

photon

10,672 1.1.9 (5 years ago) Aug 24 2018 compare

dude

413 0.1.3 (11 months ago) Feb 20 2022 compare

Other Languages

colly

22,459 v2.1.0 (4 years ago) May 14 2018 compare

pholcus

7,554 v1.3.4 (4 years ago) Feb 15 2020 compare

geziyor

2,488 2024-05-09 (2 months ago) Jun 06 2019 compare

dataflowkit

651 2024-06-25 (20 days ago) Feb 09 2017 compare

rvest

1,485 1.0.4 (1 year, 10 months ago) Nov 22 2014 compare

ferret

5,663 v0.18.0 (1 year, 3 months ago) Aug 06 2019 compare

gocrawl

2,029 (3 years ago) Nov 20 2016 compare

node-crawler

6,650 2.0.1 (20 days ago) Sep 10 2012 compare

panther

2,907 v2.1.1 (7 months ago) Jul 17 2018 compare

spidr

795 0.7.1 (5 months ago) Jul 25 2009 compare

wombat

1,308 3.0.0 (1 year, 10 months ago) Dec 27 2011 compare

ralger

153 2.2.4 (3 years ago) Dec 22 2019 compare

roach

1,337 v3.2.0 (3 months ago) Dec 27 2021 compare

phpscraper

506 3.0.0 (3 months ago) May 04 2020 compare

php-spider

1,328 v0.7.2 (7 months ago) Mar 16 2013 compare

ayakashi

200 1.0.0-beta8.4 (1 year, 17 days ago) Apr 18 2019 compare

crwlr-crawler

311 v1.9.3 (10 days ago) Apr 18 2022 compare