Skip to content

autoscraper

6,193 2 13 MIT
1.1.14 (17 Jul 2022) Jul 26 2019 9.3 thousand (month)

Autoscraper project is made for automatic web scraping to make scraping easy. It gets a url or the html content of a web page and a list of sample data which we want to scrape from that page. This data can be text, url or any html tag value of that page. It learns the scraping rules and returns the similar elements. Then you can use this learned object with new urls to get similar content or the exact same element of those new pages.

Autoscraper is minimalistic and auto-generative approach to web scraping. For example, here's a scraper that finds all titles on a stackoverflow.com page:

from autoscraper import AutoScraper

url = 'https://stackoverflow.com/questions/2081586/web-scraping-with-python'

# We can add one or multiple candidates here.
# You can also put urls here to retrieve urls.
wanted_list = ["What are metaclasses in Python?"]

scraper = AutoScraper()
result = scraper.build(url, wanted_list)
print(result)

Highlights


popularminimalisticauto-generating

Alternatives / Similar


52,353 2.11.2 (5 months ago) Jul 26 2019 compare
2,955 1.5.0 (25 days ago) Sep 04 2013 compare
3,344 0.9.13 (1 year, 3 months ago) Jul 04 2017 compare
1,749 0.8.5 (2 years ago) Oct 17 2018 compare
3,144 1.5.1 (21 days ago) Sep 30 2018 compare
246 1.33.0 (8 months ago) Feb 05 2023 compare
11,012 1.1.9 (6 years ago) Aug 24 2018 compare
424 0.1.3 (1 year, 2 months ago) Feb 20 2022 compare

Other Languages

23,241 v2.1.0 (4 years ago) May 14 2018 compare
7,566 v1.3.4 (4 years ago) Feb 15 2020 compare
2,615 2024-10-26 (a day ago) Jun 06 2019 compare
662 2024-10-22 (4 days ago) Feb 09 2017 compare
1,494 1.0.4 (2 years ago) Nov 22 2014 compare
5,716 v0.18.0 (1 year, 7 months ago) Aug 06 2019 compare
2,040 (3 years ago) Nov 20 2016 compare
6,699 2.0.2 (3 months ago) Sep 10 2012 compare
2,940 v2.1.1 (10 months ago) Jul 17 2018 compare
805 0.7.1 (9 months ago) Jul 25 2009 compare
1,312 3.0.0 (2 years ago) Dec 27 2011 compare
1,353 v3.2.0 (6 months ago) Dec 27 2021 compare
156 2.2.4 (3 years ago) Dec 22 2019 compare
533 3.0.0 (6 months ago) May 04 2020 compare
1,332 v0.7.2 (10 months ago) Mar 16 2013 compare
211 1.0.0-beta8.4 (1 year, 3 months ago) Apr 18 2019 compare
334 v2.1.2 (5 days ago) Apr 18 2022 compare
Was this page helpful?