hrequestsvsem-http-request

MIT 51 1 1,001

33.3 thousand (month) Feb 23 2022 0.9.2(2024-12-01 02:55:27 ago)

1,219 4 17 MIT

Oct 25 2009 298.2 thousand (month) 1.1.7(2020-08-31 21:38:00 ago)

hrequests is a feature rich modern replacement for a famous requests library for Python. It provides a feature rich HTTP client capable of resisting popular scraper identification techniques: - Seamless transition between headless browser and http client based requests - Integrated HTML parser - Mimicking of real browser TLS fingerprints - Javascript rendering - HTTP2 support - Realistic browser headers

em-http-request is a Ruby gem for making asynchronous HTTP requests using EventMachine. It allows you to perform multiple requests simultaneously and handle the responses as they come in, rather than waiting for each request to complete before making the next one.

In short it supports: - Asynchronous HTTP API for single & parallel request execution - Keep-Alive and HTTP pipelining support - Auto-follow 3xx redirects with max depth - Automatic gzip & deflate decoding - Streaming response processing - Streaming file uploads - HTTP proxy and SOCKS5 support - Basic Auth & OAuth - Connection-level & global middleware support - HTTP parser via http_parser.rb - Works wherever EventMachine runs: Rubinius, JRuby, MRI

Highlights

bypasshttp2tls-fingerprinthttp-fingerprintsyncasync

Example Use

hrequests has almost identical API and UX as requests and here's a quick overview: ```python import hrequests # perform HTTP client requests resp = hrequests.get('https://httpbin.org/html') print(resp.status_code) # 200 # use headless browsers and sessions: session = hrequests.Session('chrome', version=122, os="mac") # supports asyncio and easy concurrency requests = [ hrequests.async_get('https://www.google.com/', browser='firefox'), hrequests.async_get('https://www.duckduckgo.com/'), hrequests.async_get('https://www.yahoo.com/'), hrequests.async_get('https://www.httpbin.org/'), ] responses = hrequests.map(requests, size=3) # max 3 conccurency ```

```ruby EventMachine.run { http = EventMachine::HttpRequest.new('http://google.com/').get :query => {'keyname' => 'value'} # add callback for errors: http.errback { p 'Uh oh'; EM.stop } # add callback for successful requests http.callback { p http.response_header.status p http.response_header p http.response EventMachine.stop } } ```

Alternatives / Similar

curl-impersonate

5,944 compare

primp new

504 compare

curl-cffi

1,751 compare

requests

53,883 compare

node-fetch

8,860 compare

httpx

15,183 compare

aiohttp

16,395 compare

axios

108,987 compare

got

14,897 compare

needle

1,631 compare

superagent

16,610 compare

faraday

5,927 compare

pycurl

1,147 compare

puppeteer-stealth

94,086 compare

excon

1,172 compare

httpclient

707 compare

httparty

5,889 compare

puppeteer-extra new

7,293 compare

typhoeus

4,131 compare

httr

985 compare

undetected-chromedriver

12,519 compare

camoufox new

7,089 compare

guzzle

23,447 compare

rvest

1,517 compare

nodriver new

4,003 compare

wreck

378 compare

em-http-request

1,219 compare

symfony-http

2,033 compare

mechanize new

4,440 compare

treq

605 compare

http-2

908 compare

req

4,781 compare

resty

11,632 compare

nestful

505 compare

botasaurus new

4,321 compare

crul

107 compare

requests

3,577 compare

buzz

1,924 compare

selenium-driverless

718 compare

httpful

1,803 compare

ralger

165 compare

http.rb

3,104 compare

pydoll new

- compare

requests

53,883 compare

node-fetch

8,860 compare

httpx

15,183 compare

aiohttp

16,395 compare

axios

108,987 compare

got

14,897 compare

curl-impersonate

5,944 compare

needle

1,631 compare

superagent

16,610 compare

primp new

504 compare

faraday

5,927 compare

pycurl

1,147 compare

excon

1,172 compare

httpclient

707 compare

httparty

5,889 compare

typhoeus

4,131 compare

httr

985 compare

curl-cffi

1,751 compare

guzzle

23,447 compare

rvest

1,517 compare

wreck

378 compare

symfony-http

2,033 compare

mechanize new

4,440 compare

treq

605 compare

http-2

908 compare

req

4,781 compare

resty

11,632 compare

nestful

505 compare

hrequests

1,001 compare

crul

107 compare

requests

3,577 compare

buzz

1,924 compare

httpful

1,803 compare

ralger

165 compare

http.rb

3,104 compare