soupvsnokogiri

MIT 22 1 2,227

58.1 thousand (month) Apr 29 2017 v1.2.5(2022-01-16 14:36:54 ago)

6,247 23 107 MIT

Jul 25 2009 5.8 million (month) 1.19.2(2026-03-19 21:12:43 ago)

soup is a Go library for parsing and querying HTML documents.

It provides a simple and intuitive interface for extracting information from HTML pages. It's inspired by popular Python web scraping library BeautifulSoup and shares similar use API implementing functions like Find and FindAll.

soup can also use go's built-in http client to download HTML content.

Note that unlike beautifulsoup, soup does not support CSS selectors or XPath.

Nokogiri is a Ruby gem that provides a simple and powerful way to parse and search XML and HTML documents. It is built on top of the underlying C library libxml2, which is known for its speed and reliability.

Nokogiri provides a simple and intuitive API for parsing and searching XML and HTML documents, and it is widely used in the Ruby ecosystem for web scraping and data extraction.

One of the main features of Nokogiri is its ability to search and navigate through XML and HTML documents using a CSS or XPath selectors.

Nokogiri also provides a variety of other features that can simplify the process of working with XML and HTML documents. It can automatically handle character encodings and normalize documents, it can parse and search large documents with low memory usage, and it can validate documents against a DTD or schema.

Highlights

css-selectorsxpathpopular

Example Use

```go package main import ( "fmt" "log" "github.com/anaskhan96/soup" ) func main() { url := "https://www.bing.com/search?q=weather+Toronto" # soup has basic HTTP client though it's not recommended for scraping: resp, err := soup.Get(url) if err != nil { log.Fatal(err) } # create soup object from HTML doc := soup.HTMLParse(resp) # html elements can be found using Find or FindStrict methods: # in this case find

elements where "class" attribute matches some values: grid := doc.FindStrict("div", "class", "b_antiTopBleed b_antiSideBleed b_antiBottomBleed") # note: to find all elements FindAll() method can be used the same way # elements can be further searched for descendents: heading := grid.Find("div", "class", "wtr_titleCtrn").Find("div").Text() conditions := grid.Find("div", "class", "wtr_condition") primaryCondition := conditions.Find("div") secondaryCondition := primaryCondition.FindNextElementSibling() temp := primaryCondition.Find("div", "class", "wtr_condiTemp").Find("div").Text() others := primaryCondition.Find("div", "class", "wtr_condiAttribs").FindAll("div") caption := secondaryCondition.Find("div").Text() fmt.Println("City Name : " + heading) fmt.Println("Temperature : " + temp + "˚C") for _, i := range others { fmt.Println(i.Text()) } fmt.Println(caption) } ```

```ruby require 'nokogiri' html_string = 'Page Title

Hello World!

This is a sample webpage.

' # Parse the HTML string doc = Nokogiri::HTML(html_string) # Extract the class attribute of h1 tag using CSS selector h1_class = doc.css("h1")[0]['class'] # or XPath h1_class = doc.xpath("//h1")[0]['class'] puts "H1 class: #{h1_class}" ```