Skip to content

typhoeus

4,066 15 142 MIT
1.4.1 (17 Nov 2023) Oct 06 2009 982.7 thousand (month)

Typhoeus is a Ruby library that allows you to make parallel HTTP requests, which can greatly speed up the process of making multiple requests to different servers. It is built on top of the C library libcurl, which is known for its high performance and reliability.

One of the main features of Typhoeus is its ability to make parallel requests. This means that it can send multiple requests at the same time, and wait for all of them to finish before returning the results. This can greatly reduce the time it takes to make multiple requests, as it eliminates the need to wait for each request to complete before sending the next one.

In addition to its parallelism feature, Typhoeus also provides a convenient and easy-to-use Ruby interface for making HTTP requests. It supports all of the common HTTP methods (GET, POST, PUT, DELETE, etc.) and allows you to set various request options, such as headers, timeouts, and authentication. It also supports streaming responses, which allows you to process large responses piece by piece, rather than loading the entire response into memory at once.

Typhoeus is also supports HTTP/2 protocol which provides faster load times and reduced network usage. It also supports streaming which is an essential feature for large data transfer.

Typhoeus is well-documented, actively maintained, and has a large and active community of users. It is widely used in the Ruby ecosystem and is a popular choice for building high-performance web scraping and data-gathering applications.

Note that Typhoeus can also be used as an adapter in popular alternative package Faraday.

Highlights


http2asyncuses-curl

Example Use


# GET request
Typhoeus.get("www.example.com")
# POST request
Typhoeus.post("www.example.com/posts", body: { title: "test post", content: "this is my test"})

# make parallel requests:
# hydra is a request queue manager
hydra = Typhoeus::Hydra.hydra
# create request object
first_request = Typhoeus::Request.new("http://example.com/posts/1")
# add complete callbacks
first_request.on_complete do |response|
  # callbacks can queue new requests
  third_url = response.body
  third_request = Typhoeus::Request.new(third_url)
  hydra.queue third_request
end
second_request = Typhoeus::Request.new("http://example.com/posts/2")
# queue requests:
hydra.queue first_request
hydra.queue second_request

hydra.run # this is a blocking call that returns once all requests are complete

Alternatives / Similar


5,672 2.9.0 (4 months ago) Dec 19 2009 compare
698 2.8.3 (7 years ago) Jul 25 2009 compare
1,154 0.110.0 (2 months ago) Oct 31 2009 compare
5,765 0.22.0 (27 days ago) Jul 25 2009 compare
1,218 1.1.7 (3 years ago) Oct 25 2009 compare
878 0.11.0 (3 years ago) Sep 25 2013 compare
506 1.1.4 (4 years ago) Apr 20 2010 compare
2,987 0.12.0 (6 years ago) Mar 20 2015 compare

Other Languages

51,570 2.32.2 (5 days ago) Feb 14 2011 compare
8,659 3.3.2 (5 months ago) Dec 28 2012 compare
104,250 1.7.2 (5 days ago) Aug 29 2014 compare
14,643 3.9.5 (a month ago) Jul 26 2019 compare
got
13,982 14.3.0 (8 days ago) Mar 27 2014 compare
12,499 0.27.0 (3 months ago) Jul 26 2019 compare
16,538 9.0.2 (27 days ago) Aug 22 2011 compare
1,614 3.3.1 (5 months ago) Dec 11 2011 compare
1,048 7.45.3 (3 months ago) Feb 25 2003 compare
981 1.4.7 (1 year, 19 days ago) May 06 2012 compare
1,479 1.0.4 (1 year, 9 months ago) Nov 22 2014 compare
22,795 7.8.0 (8 months ago) Nov 14 2011 compare
383 18.1.0 (4 months ago) Aug 06 2011 compare
1,887 v7.1.0-RC1 (13 days ago) Apr 28 2019 compare
582 23.11.0 (6 months ago) Dec 28 2012 compare
102 1.4.2 (1 year, 10 days ago) Nov 09 2016 compare
req
4,050 v3.43.5 (10 days ago) Jun 17 2023 compare
9,452 v2.13.1 (15 days ago) Oct 28 2018 compare
3,560 v2.0.11 (2 months ago) Oct 06 2013 compare
1,921 1.2.1 (2 years ago) Nov 11 2011 compare
1,736 1.0.0 (25 days ago) Apr 14 2012 compare
152 2.2.4 (3 years ago) Dec 22 2019 compare
Was this page helpful?