Ruby Libraries Used in Web Scraping

http-client

faraday
5,702 2.9.2 (27 days ago) Dec 19 2009
httpclient
699 2.8.3 (7 years ago) Jul 25 2009
excon
1,154 0.110.0 (4 months ago) Oct 31 2009
httparty
5,776 0.22.0 (2 months ago) Jul 25 2009
typhoeus
4,073 1.4.1 (7 months ago) Oct 06 2009
em-http-request
1,220 1.1.7 (3 years ago) Oct 25 2009
http-2
887 1.0.0 (17 days ago) Sep 25 2013
nestful
507 1.1.4 (4 years ago) Apr 20 2010
http.rb
2,994 0.12.0 (6 years ago) Mar 20 2015

xml-util

ox
897 2.14.18 (3 months ago) Jul 01 2011
roxml
222 4.2.0 (2 years ago) Aug 05 2009
happymapper
152 0.10.0 (6 months ago) Mar 19 2010

html-util

loofah
931 2.22.0 (8 months ago) Aug 18 2009
html-pipeline
2,264 3.2.0 (2 months ago) Nov 07 2012

ETL

kiba
1,730 4.0.0 (3 years ago) Apr 18 2015

data

kiba
1,730 4.0.0 (3 years ago) Apr 18 2015

html-parser

nokogiri
6,118 1.16.6 (a month ago) Jul 25 2009

xpath

nokogiri
6,118 1.16.6 (a month ago) Jul 25 2009

css-selectors

nokogiri
6,118 1.16.6 (a month ago) Jul 25 2009

framework

spidr
795 0.7.1 (5 months ago) Jul 25 2009
wombat
1,308 3.0.0 (1 year, 10 months ago) Dec 27 2011
Was this page helpful?