Ruby Libraries Used in Web Scraping

http-client

faraday
5,748 2.12.0 (a month ago) Dec 19 2009
httpclient
702 2.8.3 (7 years ago) Jul 25 2009
excon
1,158 1.0.0 (3 days ago) Oct 31 2009
httparty
5,807 0.22.0 (5 months ago) Jul 25 2009
typhoeus
4,079 1.4.1 (11 months ago) Oct 06 2009
em-http-request
1,219 1.1.7 (4 years ago) Oct 25 2009
http-2
894 1.0.1 (3 months ago) Sep 25 2013
nestful
507 1.1.4 (4 years ago) Apr 20 2010
http.rb
3,007 0.12.0 (7 years ago) Mar 20 2015

xml-util

ox
901 2.14.18 (7 months ago) Jul 01 2011
roxml
223 4.2.0 (3 years ago) Aug 05 2009
happymapper
151 0.10.0 (9 months ago) Mar 19 2010

html-util

loofah
932 2.23.1 (2 days ago) Aug 18 2009
html-pipeline
2,265 3.2.1 (2 months ago) Nov 07 2012

data

kiba
1,750 4.0.0 (3 years ago) Apr 18 2015

ETL

kiba
1,750 4.0.0 (3 years ago) Apr 18 2015

html-parser

nokogiri
6,137 1.16.7 (2 months ago) Jul 25 2009

css-selectors

nokogiri
6,137 1.16.7 (2 months ago) Jul 25 2009

xpath

nokogiri
6,137 1.16.7 (2 months ago) Jul 25 2009

framework

spidr
805 0.7.1 (9 months ago) Jul 25 2009
wombat
1,312 3.0.0 (2 years ago) Dec 27 2011
Was this page helpful?