Skip to content

chopper

22 3 1 MIT
0.6.0 (26 Apr 2023) Jul 24 2014 747 (month)

Chopper is a tool to extract elements from HTML by preserving ancestors and CSS rules.

Compared to other HTML parsers Chopper is designed to retain original HTML tree but eliminate elements that do not match parsing rules. Meaning, we can parse HTML elements and keep thei structure for machine learning or other tasks where data structure is needed as well as the data value.

Example Use


HTML = """
<html>
  <head>
    <title>Test</title>
  </head>
  <body>
    <div id="header"></div>
    <div id="main">
      <div class="iwantthis">
        HELLO WORLD
        <a href="/nope">Do not want</a>
      </div>
    </div>
    <div id="footer"></div>
  </body>
</html>
"""

CSS = """
div { border: 1px solid black; }
div#main { color: blue; }
div.iwantthis { background-color: red; }
a { color: green; }
div#footer { border-top: 2px solid red; }
"""

extractor = Extractor.keep('//div[@class="iwantthis"]').discard('//a')
html, css = extractor.extract(HTML, CSS)

# will result in:
html
"""
<html>
  <body>
    <div id="main">
      <div class="iwantthis">
        HELLO WORLD
      </div>
    </div>
  </body>
</html>"""

css
"""
div{border:1px solid black;}
div#main{color:blue;}
div.iwantthis{background-color:red;}
"""

Alternatives / Similar


2,484 4.9.3 (4 months ago) Dec 13 2022 compare
- 4.12.2 (7 months ago) Jul 26 2019 compare
5,269 0.13.0 (1 year, 6 months ago) Jul 30 2007 compare
1,072 1.1 (3 years ago) Jul 30 2007 compare
275 1.2.0 (1 year, 1 month ago) Apr 14 2012 compare
1,734 6.0.10 (1 year, 6 months ago) Jun 15 2007 compare
2,243 2.0.0 (11 months ago) Dec 05 2008 compare
1,020 1.8.1 (7 months ago) Jul 26 2019 compare
13,416 0.10.0 (4 years ago) Feb 25 2018 compare
655 0.4.12 (10 days ago) Jun 03 2007 compare
605 1.2.1 (1 year, 4 months ago) Jun 09 2011 compare
895 0.3.17 (a month ago) Mar 01 2018 compare
159 1.2.2 (5 months ago) Jul 30 2007 compare
716 1.1 (3 years ago) Dec 28 2012 compare

Other Languages

3,463 7.1.2 (4 months ago) Jul 03 2013 compare
1,058 1.3.0 (2 months ago) Feb 09 2011 compare
4,034 9.0.0 (6 months ago) Aug 28 2011 compare
27,140 1.0.0-rc.12 (22 days ago) Oct 08 2011 compare
6,077 1.15.5 (11 days ago) Jul 25 2009 compare
213 1.3.5 (7 months ago) Apr 20 2015 compare
1,428 1.0.3 (2 years ago) Nov 22 2014 compare
3,867 v7.0.0-RC1 (14 days ago) Sep 26 2011 compare
1,381 2.8.1 (6 months ago) Jun 01 2013 compare
13,155 v1.8.1 (9 months ago) Aug 29 2016 compare
645 Start (5 years ago) Feb 20 2018 compare
609 v1.2.5 (a month ago) Jun 08 2019 compare
2,080 v1.2.5 (1 year, 10 months ago) Apr 29 2017 compare
649 v1.3.0 (10 months ago) Feb 07 2019 compare
2,041 v4.4.8 (6 months ago) Oct 26 2013 compare
150 2.2.4 (2 years ago) Dec 22 2019 compare