choppervshtml5lib

python html-parser

python html-parser

MIT 1 3 23

1.7 thousand (month) Jul 24 2014 0.6.0(2023-04-26 10:16:25 ago)

1,220 14 97 MIT

Jul 30 2007 32.8 million (month) 1.1(2020-06-22 23:32:36 ago)

---

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules.

Compared to other HTML parsers Chopper is designed to retain original HTML tree but eliminate elements that do not match parsing rules. Meaning, we can parse HTML elements and keep thei structure for machine learning or other tasks where data structure is needed as well as the data value.

html5lib is a pure-python library for parsing HTML. It is designed to conform to the WHATWG HTML specification, as is implemented by all major web browsers.

As html5lib is implemented in pure-python it is significantly slower than alternatives powered by lxml (like parsel or beautifulsoup). However, html5lib implements a more true html5 parsing which can represent HTML tree more correctly than alternatives.

Example Use

---

```python HTML = """

HELLO WORLD Do not want

<div id="footer"></div>

"""

CSS = """ div { border: 1px solid black; } div#main { color: blue; } div.iwantthis { background-color: red; } a { color: green; } div#footer { border-top: 2px solid red; } """

extractor = Extractor.keep('//div[@class="iwantthis"]').discard('//a') html, css = extractor.extract(HTML, CSS)

will result in:

html """

HELLO WORLD

"""

css """ div{border:1px solid black;} div#main{color:blue;} div.iwantthis{background-color:red;} """ ```

```python import html5lib from html5lib import parse

html_doc = "" parsed = parse(html_doc) title = parsed.getElementsByTagName("title")[0] print(title.childNodes[0].nodeValue) ```

Alternatives / Similar

---

parse5

3,886 compare

sax-js

1,153 compare

htmlparser2

4,789 compare

lxml

3,010 compare

beautifulsoup

- compare

jsdom new

21,552 compare

xmltodict

5,734 compare

cheerio

30,265 compare

html5lib

1,220 compare

cssselect

309 compare

feedparser

2,351 compare

nokogiri

6,248 compare

parsel

1,324 compare

selectolax

1,607 compare

pyquery

2,381 compare

xml2

223 compare

requests-html

13,863 compare

rvest

1,517 compare

untangle

632 compare

scrapling new

36,206 compare

html5-php

1,772 compare

domcrawler

4,038 compare

goquery

14,926 compare

cascadia

754 compare

htmlquery

781 compare

xpath

739 compare

soup

2,227 compare

chompjs

218 compare

html5-parser

700 compare

gazpacho

768 compare

embed

2,103 compare

simple-html-dom new

- compare

ralger

165 compare

parse5

3,886 compare

sax-js

1,153 compare

htmlparser2

4,789 compare

lxml

3,010 compare

beautifulsoup

- compare

jsdom new

21,552 compare

xmltodict

5,734 compare

cheerio

30,265 compare

cssselect

309 compare

feedparser

2,351 compare

nokogiri

6,248 compare

parsel

1,324 compare

selectolax

1,607 compare

pyquery

2,381 compare

xml2

223 compare

requests-html

13,863 compare

rvest

1,517 compare

untangle

632 compare

scrapling new

36,206 compare

html5-php

1,772 compare

domcrawler

4,038 compare

goquery

14,926 compare

cascadia

754 compare

htmlquery

781 compare

xpath

739 compare

soup

2,227 compare

chompjs

218 compare

html5-parser

700 compare

gazpacho

768 compare

embed

2,103 compare

chopper

23 compare

simple-html-dom new

- compare

ralger

165 compare