Skip to content

parsel

1,073 8 36 BSD
1.9.1 (8 Apr 2024) Jul 26 2019 1.5 million (month)

parsel is a library for parsing HTML and XML using selectors, similar to beautifulsoup. It is built on top of the lxml library and allows for easy extraction of data from HTML and XML files using selectors, similar to how you would use CSS selectors in web development. It is a light-weight library which is specifically designed for web scraping and parsing, so it is more efficient and faster than beautifulsoup in some use cases.

Some of the key features of parsel include:

  • CSS selector & XPath selector support:
    Two most common html parsing path languages are both supported in parsel. This allows selecting attributes, tags, text and complex matching rules that use regular expressions or XPath functions.
  • Modifying data:
    parsel allows you to modify the contents of an element, remove elements or add new elements to a document.
  • Support for both HTML and XML:
    parsel supports both HTML and XML documents and you can use the same selectors for both formats.

It is easy to use and less verbose than beautifulsoup, so it's quite popular among the developers who are working with Web scraping projects and parse data from large volume of web pages.

Highlights


css-selectorsxpath-selectors

Example Use


from parsel import Selector

# this is our HTML page:
html = """
<head>
  <title>Hello World!</title>
</head>
<body>
  <div id="product">
    <h1>Product Title</h1>
    <p>paragraph 1</p>
    <p>paragraph2</p>
    <span class="price">$10</span>
  </div>
</body>
"""

selector = Selector(html)

# we can use CSS selectors:
selector.css("#product .price::text").get()
"$10"

# or XPath:
selector.xpath('//span[@class="price"]').get()
"$10"

# or get all matching elements:
print(selector.css("#product p::text").getall())
["paragraph 1", "paragraph2"]

# parsel also comes with utility methods like regular expression parsing:
selector.xpath('//span[@class="price"]').re("\d+")
["10"]

Alternatives / Similar


- 4.12.3 (3 months ago) Jul 26 2019 compare
2,580 5.2.1 (a month ago) Dec 13 2022 compare
5,389 0.13.0 (2 years ago) Jul 30 2007 compare
1,095 1.1 (3 years ago) Jul 30 2007 compare
281 1.2.0 (1 year, 6 months ago) Apr 14 2012 compare
2,272 2.0.0 (1 year, 4 months ago) Dec 05 2008 compare
1,845 6.0.11 (5 months ago) Jun 15 2007 compare
13,599 0.10.0 (5 years ago) Feb 25 2018 compare
663 0.4.12 (5 months ago) Jun 03 2007 compare
607 1.2.1 (1 year, 10 months ago) Jun 09 2011 compare
974 0.3.21 (2 months ago) Mar 01 2018 compare
177 1.2.3 (3 months ago) Jul 30 2007 compare
732 1.1 (3 years ago) Dec 28 2012 compare
22 0.6.0 (1 year, 16 days ago) Jul 24 2014 compare

Other Languages

3,558 7.1.2 (10 months ago) Jul 03 2013 compare
1,074 1.3.0 (7 months ago) Feb 09 2011 compare
4,296 9.1.0 (4 months ago) Aug 28 2011 compare
27,832 1.0.0-rc.12 (6 months ago) Oct 08 2011 compare
6,108 1.16.4 (a month ago) Jul 25 2009 compare
218 1.3.6 (10 months ago) Apr 20 2015 compare
1,476 1.0.4 (1 year, 8 months ago) Nov 22 2014 compare
1,487 2.9.0 (a month ago) Jun 01 2013 compare
3,909 v7.1.0-BETA1 (23 days ago) Sep 26 2011 compare
677 Start (6 years ago) Feb 20 2018 compare
13,596 v1.9.2 (12 days ago) Aug 29 2016 compare
701 v1.3.1 (a month ago) Feb 07 2019 compare
2,129 v1.2.5 (2 years ago) Apr 29 2017 compare
655 (a month ago) Jun 08 2019 compare
2,065 v4.4.10 (5 months ago) Oct 26 2013 compare
152 2.2.4 (3 years ago) Dec 22 2019 compare