Skip to content

ralger

150 1 3 MIT
2.2.4 (23 Feb 2021) Dec 22 2019 991 (month)

ralger is a small web scraping framework for R based on rvest and xml2.

It's goal to simplify basic web scraping and it provides a convenient and easy to use API.

It offers functions for retrieving pages, parsing HTML using CSS selectors, automatic table parsing and auto link, title, image and paragraph extraction.

Example Use


library("ralger")

url <- "http://www.shanghairanking.com/rankings/arwu/2021"

# retrieve HTML and select elements using CSS selectors:
best_uni <- scrap(link = url, node = "a span", clean = TRUE)
head(best_uni, 5)
#>  [1] "Harvard University"
#>  [2] "Stanford University"
#>  [3] "University of Cambridge"
#>  [4] "Massachusetts Institute of Technology (MIT)"
#>  [5] "University of California, Berkeley"

# ralger can also parse HTML attributes
attributes <- attribute_scrap(
  link = "https://ropensci.org/",
  node = "a", # the a tag
  attr = "class" # getting the class attribute
)

head(attributes, 10) # NA values are a tags without a class attribute
#>  [1] "navbar-brand logo" "nav-link"          NA
#>  [4] NA                  NA                  "nav-link"
#>  [7] NA                  "nav-link"          NA
#> [10] NA
#

# ralger can automatically scrape tables:
data <- table_scrap(link ="https://www.boxofficemojo.com/chart/top_lifetime_gross/?area=XWW")

head(data)
#> # A tibble: 6 × 4
#>    Rank Title                                      `Lifetime Gross`  Year
#>   <int> <chr>                                      <chr>            <int>
#> 1     1 Avatar                                     $2,847,397,339    2009
#> 2     2 Avengers: Endgame                          $2,797,501,328    2019
#> 3     3 Titanic                                    $2,201,647,264    1997
#> 4     4 Star Wars: Episode VII - The Force Awakens $2,069,521,700    2015
#> 5     5 Avengers: Infinity War                     $2,048,359,754    2018
#> 6     6 Spider-Man: No Way Home                    $1,901,216,740    2021

Alternatives / Similar


1,428 1.0.3 (2 years ago) Nov 22 2014 compare
975 1.4.7 (6 months ago) May 06 2012 compare
213 1.3.5 (7 months ago) Apr 20 2015 compare
101 1.4.0 (1 year, 2 months ago) Nov 09 2016 compare

Other Languages

50,569 2.31.0 (6 months ago) Feb 14 2011 compare
21,215 v2.1.0 (3 years ago) May 14 2018 compare
102,345 1.6.0 (a month ago) Aug 29 2014 compare
8,535 3.3.2 (3 months ago) Dec 28 2012 compare
3,463 7.1.2 (4 months ago) Jul 03 2013 compare
1,058 1.3.0 (2 months ago) Feb 09 2011 compare
4,034 9.0.0 (6 months ago) Aug 28 2011 compare
14,116 3.9.0 (11 days ago) Jul 26 2019 compare
2,484 4.9.3 (4 months ago) Dec 13 2022 compare
got
13,576 13.0.0 (6 months ago) Mar 27 2014 compare
7,476 v1.3.4 (3 years ago) Feb 15 2020 compare
- 4.12.2 (7 months ago) Jul 26 2019 compare
16,449 8.1.2 (3 months ago) Aug 22 2011 compare
1,599 3.2.0 (1 year, 12 days ago) Dec 11 2011 compare
5,269 0.13.0 (1 year, 6 months ago) Jul 30 2007 compare
27,140 1.0.0-rc.12 (22 days ago) Oct 08 2011 compare
11,446 0.25.1 (26 days ago) Jul 26 2019 compare
2,296 2023-11-24 (4 days ago) Jun 06 2019 compare
1,072 1.1 (3 years ago) Jul 30 2007 compare
622 2023-11-24 (4 days ago) Feb 09 2017 compare
275 1.2.0 (1 year, 1 month ago) Apr 14 2012 compare
5,578 2.7.11 (2 months ago) Dec 19 2009 compare
6,077 1.15.5 (11 days ago) Jul 25 2009 compare
695 2.8.3 (6 years ago) Jul 25 2009 compare
1,147 0.104.0 (a month ago) Oct 31 2009 compare
1,734 6.0.10 (1 year, 6 months ago) Jun 15 2007 compare
2,243 2.0.0 (11 months ago) Dec 05 2008 compare
5,721 0.21.0 (10 months ago) Jul 25 2009 compare
49,364 2.11.0 (2 months ago) Jul 26 2019 compare
1,020 1.8.1 (7 months ago) Jul 26 2019 compare
1,019 7.45.2 (11 months ago) Feb 25 2003 compare
13,416 0.10.0 (4 years ago) Feb 25 2018 compare
4,045 1.4.1 (12 days ago) Oct 06 2009 compare
22,789 7.8.0 (3 months ago) Nov 14 2011 compare
1,217 1.1.7 (3 years ago) Oct 25 2009 compare
382 18.1.0 (20 days ago) Aug 06 2011 compare
1,819 v7.0.0-RC1 (22 days ago) Apr 28 2019 compare
2,734 1.4.3 (2 months ago) Sep 04 2013 compare
877 0.11.0 (2 years ago) Sep 25 2013 compare
655 0.4.12 (10 days ago) Jun 03 2007 compare
3,867 v7.0.0-RC1 (14 days ago) Sep 26 2011 compare
1,381 2.8.1 (6 months ago) Jun 01 2013 compare
605 1.2.1 (1 year, 4 months ago) Jun 09 2011 compare
565 23.11.0 (25 days ago) Dec 28 2012 compare
6,541 1.4.0 (10 months ago) Sep 10 2012 compare
13,155 v1.8.1 (9 months ago) Aug 29 2016 compare
645 Start (5 years ago) Feb 20 2018 compare
609 v1.2.5 (a month ago) Jun 08 2019 compare
req
3,766 v3.42.2 (9 days ago) Apr 29 2023 compare
8,664 v2.10.0 (a month ago) Aug 05 2018 compare
2,080 v1.2.5 (1 year, 10 months ago) Apr 29 2017 compare
649 v1.3.0 (10 months ago) Feb 07 2019 compare
5,513 v0.18.0 (8 months ago) Aug 06 2019 compare
2,021 (2 years ago) Nov 20 2016 compare
895 0.3.17 (a month ago) Mar 01 2018 compare
506 1.1.4 (3 years ago) Apr 20 2010 compare
3,536 v2.0.9 (20 days ago) Oct 06 2013 compare
159 1.2.2 (5 months ago) Jul 30 2007 compare
716 1.1 (3 years ago) Dec 28 2012 compare
1,916 1.2.1 (1 year, 8 months ago) Nov 11 2011 compare
2,829 v2.1.0 (5 months ago) Jul 17 2018 compare
1,737 0.3.2 (3 years ago) Apr 14 2012 compare
2,041 v4.4.8 (6 months ago) Oct 26 2013 compare
5,654 1.1.14 (1 year, 4 months ago) Jul 26 2019 compare
1,298 3.0.0 (1 year, 3 months ago) Dec 27 2011 compare
769 0.7.0 (10 months ago) Jul 25 2009 compare
1,701 0.8.5 (1 year, 2 months ago) Oct 17 2018 compare
2,864 1.4.1 (2 months ago) Sep 30 2018 compare
22 0.6.0 (7 months ago) Jul 24 2014 compare
3,118 0.9.13 (4 months ago) Jul 04 2017 compare
2,968 0.12.0 (6 years ago) Mar 20 2015 compare
10,120 1.1.9 (5 years ago) Aug 24 2018 compare
1,271 2.0.1 (9 months ago) Dec 27 2021 compare
224 1.27.1 (3 months ago) Feb 05 2023 compare
443 2.0.0 (5 months ago) May 04 2020 compare
1,312 v0.7.1 (3 months ago) Mar 16 2013 compare
186 1.0.0-beta8.4 (5 months ago) Apr 18 2019 compare
386 0.1.3 (3 months ago) Feb 20 2022 compare
277 v1.3.0 (a month ago) Apr 18 2022 compare