Http-Client Libraries Used in Web Scraping

ruby

http.rb
3,013 0.12.1 (6 months ago) Mar 20 2015
nestful
505 1.1.4 (5 years ago) Apr 20 2010
http-2
898 1.0.2 (9 months ago) Sep 25 2013
em-http-request
1,217 1.1.7 (4 years ago) Oct 25 2009
typhoeus
4,084 1.4.1 (1 year, 9 months ago) Oct 06 2009
httparty
5,837 0.22.0 (1 year, 3 months ago) Jul 25 2009
excon
1,163 1.2.3 (7 months ago) Oct 31 2009
httpclient
703 2.8.3 (8 years ago) Jul 25 2009
faraday
5,785 2.12.2 (8 months ago) Dec 19 2009

javascript

wreck
381 18.1.0 (1 year, 19 days ago) Aug 06 2011
needle
1,637 3.3.1 (1 year, 8 months ago) Dec 11 2011
superagent
16,610 10.1.1 (10 months ago) Aug 22 2011
got
14,454 14.4.6 (6 months ago) Mar 27 2014
axios
106,345 1.7.9 (8 months ago) Aug 29 2014
node-fetch
8,825 3.3.2 (1 year, 8 months ago) Dec 28 2012

python

hrequests
780 0.9.2 (8 months ago) Feb 23 2022
treq
590 24.9.1 (11 months ago) Dec 28 2012
curl-cffi
1,751 0.7.1 (1 year, 1 month ago) Feb 23 2022
pycurl
1,094 7.45.4 (8 months ago) Feb 25 2003
curl-impersonate
4,221 v0.6.1 (1 year, 5 months ago) Feb 23 2022
httpx
13,703 0.28.1 (8 months ago) Jul 26 2019
aiohttp
15,425 3.11.12 (6 months ago) Jul 26 2019
requests
52,519 2.32.3 (1 year, 2 months ago) Feb 14 2011

php

httpful
1,741 1.0.0 (1 year, 3 months ago) Apr 14 2012
buzz
1,913 1.3.0 (11 months ago) Nov 11 2011
requests
3,576 v2.0.15 (7 months ago) Oct 06 2013
symfony-http
1,976 v7.2.3 (6 months ago) Apr 28 2019
guzzle
23,055 7.9.1 (1 year, 1 month ago) Nov 14 2011

go

resty
10,341 v3.0.0-alpha.6 (7 months ago) May 21 2020
req
4,374 v3.49.1 (8 months ago) Aug 12 2023

r

ralger
156 2.2.4 (4 years ago) Dec 22 2019
crul
107 1.5.0 (1 year, 4 months ago) Nov 09 2016
rvest
1,498 1.0.4 (3 years ago) Nov 22 2014
httr
988 1.4.7 (2 years ago) May 06 2012
Was this page helpful?