Skip to content

readability

2,572 4 39 Apache License 2.0
0.8.1 (4 Jul 2020) Jun 30 2011 386.9 thousand (month)

python-readability is a python package that allows developers to extract the main content of a web page, removing any unnecessary or unwanted elements, such as ads, navigation, and sidebars.

It is based on the algorithm used by the popular web-based service, Readability, and it uses the beautifulsoup4 package to parse the HTML and extract the main content.

Readability is similar to Newspaper in terms that it's extracting HTML data

Example Use


import requests
from readability import document

response = requests.get('http://example.com')
doc = document(response.content)
doc.title()
'example domain'

doc.summary()
"""<html><body><div><body id="readabilitybody">\n<div>\n    <h1>example domain</h1>\n
<p>this domain is established to be used for illustrative examples in documents. you may
use this\n    domain in examples without prior coordination or asking for permission.</p>
\n    <p><a href="http://www.iana.org/domains/example">more information...</a></p>\n</div>
\n</body>\n</div></body></html>"""

Alternatives / Similar


1,595 2024.2.26 (2 months ago) Dec 14 2008 compare
13,679 0.2.8 (5 years ago) Dec 28 2012 compare
2,911 1.9.0 (9 days ago) Jul 17 2019 compare
3,429 0.11.0 (1 year, 6 months ago) Oct 20 2013 compare
823 0.16.0 (10 months ago) Oct 27 2015 compare
172 2.0.7 (1 year, 6 months ago) Dec 11 2020 compare
10,534 1.1.9 (5 years ago) Aug 24 2018 compare

Other Languages

2,400 v1.3.0 (2 months ago) Apr 20 2016 compare