Http-Client Libraries Used in Web Scraping

php

httpful
1,737 0.3.2 (3 years ago) Apr 14 2012
buzz
1,916 1.2.1 (1 year, 8 months ago) Nov 11 2011
requests
3,536 v2.0.9 (20 days ago) Oct 06 2013
symfony-http
1,819 v7.0.0-RC1 (22 days ago) Apr 28 2019
guzzle
22,789 7.8.0 (3 months ago) Nov 14 2011

go

req
3,766 v3.42.2 (9 days ago) Apr 29 2023
resty
8,664 v2.10.0 (a month ago) Aug 05 2018

r

ralger
150 2.2.4 (2 years ago) Dec 22 2019
crul
101 1.4.0 (1 year, 2 months ago) Nov 09 2016
rvest
1,428 1.0.3 (2 years ago) Nov 22 2014
httr
975 1.4.7 (6 months ago) May 06 2012

javascript

wreck
382 18.1.0 (20 days ago) Aug 06 2011
needle
1,599 3.2.0 (1 year, 12 days ago) Dec 11 2011
superagent
16,449 8.1.2 (3 months ago) Aug 22 2011
got
13,576 13.0.0 (6 months ago) Mar 27 2014
node-fetch
8,535 3.3.2 (3 months ago) Dec 28 2012
axios
102,345 1.6.0 (a month ago) Aug 29 2014

ruby

http.rb
2,968 0.12.0 (6 years ago) Mar 20 2015
nestful
506 1.1.4 (3 years ago) Apr 20 2010
http-2
877 0.11.0 (2 years ago) Sep 25 2013
em-http-request
1,217 1.1.7 (3 years ago) Oct 25 2009
typhoeus
4,045 1.4.1 (12 days ago) Oct 06 2009
httparty
5,721 0.21.0 (10 months ago) Jul 25 2009
excon
1,147 0.104.0 (a month ago) Oct 31 2009
httpclient
695 2.8.3 (6 years ago) Jul 25 2009
faraday
5,578 2.7.11 (2 months ago) Dec 19 2009

python

treq
565 23.11.0 (25 days ago) Dec 28 2012
pycurl
1,019 7.45.2 (11 months ago) Feb 25 2003
httpx
11,446 0.25.1 (26 days ago) Jul 26 2019
aiohttp
14,116 3.9.0 (11 days ago) Jul 26 2019
requests
50,569 2.31.0 (6 months ago) Feb 14 2011