Skip to content

hrequests

541 1 13 Apache-2.0
0.8.2 (31 Mar 2024) Feb 23 2022 2.5 thousand (month)

hrequests is a feature rich modern replacement for a famous requests library for Python. It provides a feature rich HTTP client capable of resisting popular scraper identification techniques: - Seamless transition between headless browser and http client based requests - Integrated HTML parser - Mimicking of real browser TLS fingerprints - Javascript rendering - HTTP2 support - Realistic browser headers

Highlights


bypasshttp2tls-fingerprinthttp-fingerprintsyncasync

Example Use


hrequests has almost identical API and UX as requests and here's a quick overview:

import hrequests

# perform HTTP client requests
resp = hrequests.get('https://httpbin.org/html')
print(resp.status_code)
# 200

# use headless browsers and sessions:
session = hrequests.Session('chrome', version=122, os="mac")

# supports asyncio and easy concurrency
requests = [
    hrequests.async_get('https://www.google.com/', browser='firefox'),
    hrequests.async_get('https://www.duckduckgo.com/'),
    hrequests.async_get('https://www.yahoo.com/'),
    hrequests.async_get('https://www.httpbin.org/'),
]
responses = hrequests.map(requests, size=3)  # max 3 conccurency

Alternatives / Similar


3,452 v0.6.1 (4 months ago) Feb 23 2022 compare
1,603 0.6.4 (a month ago) Feb 23 2022 compare
51,712 2.32.3 (a month ago) Feb 14 2011 compare
14,760 3.9.5 (2 months ago) Jul 26 2019 compare
12,662 0.27.0 (4 months ago) Jul 26 2019 compare
1,055 7.45.3 (4 months ago) Feb 25 2003 compare
9,015 3.5.5 (4 months ago) Sep 04 2020 compare
584 23.11.0 (8 months ago) Dec 28 2012 compare
386 1.9.3.1 (a month ago) Jul 22 2022 compare

Other Languages

8,703 3.3.2 (7 months ago) Dec 28 2012 compare
104,548 1.7.2 (a month ago) Aug 29 2014 compare
got
14,048 14.4.1 (30 days ago) Mar 27 2014 compare
16,562 9.0.2 (2 months ago) Aug 22 2011 compare
1,619 3.3.1 (6 months ago) Dec 11 2011 compare
5,694 2.9.2 (18 days ago) Dec 19 2009 compare
699 2.8.3 (7 years ago) Jul 25 2009 compare
1,154 0.110.0 (3 months ago) Oct 31 2009 compare
87,572 2.11.2 (1 year, 2 months ago) May 29 2018 compare
5,776 0.22.0 (2 months ago) Jul 25 2009 compare
4,073 1.4.1 (7 months ago) Oct 06 2009 compare
983 1.4.7 (1 year, 1 month ago) May 06 2012 compare
1,485 1.0.4 (1 year, 10 months ago) Nov 22 2014 compare
22,795 7.8.0 (10 months ago) Nov 14 2011 compare
1,220 1.1.7 (3 years ago) Oct 25 2009 compare
383 18.1.0 (5 months ago) Aug 06 2011 compare
1,898 v7.1.2 (8 days ago) Apr 28 2019 compare
885 1.0.0 (8 days ago) Sep 25 2013 compare
102 1.4.2 (1 year, 1 month ago) Nov 09 2016 compare
req
4,117 v3.43.7 (a month ago) Jun 28 2023 compare
9,603 v2.13.1 (a month ago) Oct 28 2018 compare
507 1.1.4 (4 years ago) Apr 20 2010 compare
3,563 v2.0.11 (3 months ago) Oct 06 2013 compare
1,919 1.2.1 (2 years ago) Nov 11 2011 compare
1,739 1.0.0 (2 months ago) Apr 14 2012 compare
152 2.2.4 (3 years ago) Dec 22 2019 compare
2,992 0.12.0 (6 years ago) Mar 20 2015 compare
Was this page helpful?