Http-Client Libraries Used in Web Scraping

go

req
4,126 v3.43.7 (a month ago) Jun 28 2023
resty
9,632 v2.13.1 (2 months ago) Oct 28 2018

javascript

wreck
383 18.1.0 (6 months ago) Aug 06 2011
needle
1,619 3.3.1 (7 months ago) Dec 11 2011
superagent
16,564 9.0.2 (2 months ago) Aug 22 2011
got
14,053 14.4.1 (a month ago) Mar 27 2014
axios
104,592 1.7.2 (a month ago) Aug 29 2014
node-fetch
8,709 3.3.2 (7 months ago) Dec 28 2012

php

httpful
1,738 1.0.0 (2 months ago) Apr 14 2012
buzz
1,919 1.2.1 (2 years ago) Nov 11 2011
requests
3,564 v2.0.11 (3 months ago) Oct 06 2013
symfony-http
1,898 v7.1.2 (17 days ago) Apr 28 2019
guzzle
22,795 7.8.0 (10 months ago) Nov 14 2011

python

hrequests
541 0.8.2 (3 months ago) Feb 23 2022
treq
585 23.11.0 (8 months ago) Dec 28 2012
curl-cffi
1,633 0.7.0 (12 days ago) Feb 23 2022
pycurl
1,058 7.45.3 (4 months ago) Feb 25 2003
curl-impersonate
3,467 v0.6.1 (4 months ago) Feb 23 2022
httpx
12,702 0.27.0 (4 months ago) Jul 26 2019
aiohttp
14,776 3.9.5 (2 months ago) Jul 26 2019
requests
51,729 2.32.3 (a month ago) Feb 14 2011

r

ralger
153 2.2.4 (3 years ago) Dec 22 2019
crul
102 1.4.2 (1 year, 1 month ago) Nov 09 2016
rvest
1,485 1.0.4 (1 year, 10 months ago) Nov 22 2014
httr
982 1.4.7 (1 year, 2 months ago) May 06 2012

ruby

http.rb
2,994 0.12.0 (6 years ago) Mar 20 2015
nestful
507 1.1.4 (4 years ago) Apr 20 2010
http-2
887 1.0.0 (17 days ago) Sep 25 2013
em-http-request
1,220 1.1.7 (3 years ago) Oct 25 2009
typhoeus
4,073 1.4.1 (7 months ago) Oct 06 2009
httparty
5,776 0.22.0 (2 months ago) Jul 25 2009
excon
1,154 0.110.0 (4 months ago) Oct 31 2009
httpclient
699 2.8.3 (7 years ago) Jul 25 2009
faraday
5,702 2.9.2 (27 days ago) Dec 19 2009
Was this page helpful?