Python Libraries Used in Web Scraping educational cloudscraper 6,431 1.2.71 (2023-04-25 23:20:15 ago) Dec 28 2012 youtube-dl 140,026 2021.12.17 (2021-12-16 19:02:14 ago) Feb 22 2012 you-get 56,813 0.4.1743 (2025-01-04 01:51:10 ago) Sep 01 2012 cli-tool youtube-dl 140,026 2021.12.17 (2021-12-16 19:02:14 ago) Feb 22 2012 you-get 56,813 0.4.1743 (2025-01-04 01:51:10 ago) Sep 01 2012 scraper trafilatura 5,650 2.0.0 (2024-12-03 15:23:21 ago) Jul 17 2019 youtube-dl 140,026 2021.12.17 (2021-12-16 19:02:14 ago) Feb 22 2012 you-get 56,813 0.4.1743 (2025-01-04 01:51:10 ago) Sep 01 2012 http-client requests 53,883 2.33.1 (2026-03-30 16:09:13 ago) Feb 14 2011 httpx 15,183 0.28.1 (2024-12-06 15:37:21 ago) Jul 26 2019 aiohttp 16,395 3.13.5 (2026-03-31 21:56:30 ago) Jul 26 2019 curl-impersonate 5,944 v0.6.1 (2024-03-02 18:08:29 ago) Feb 23 2022 primp new 504 1.2.2 (2026-04-03 07:11:15 ago) Jun 01 2024 pycurl 1,147 7.45.7 (2025-09-24 13:35:56 ago) Feb 25 2003 curl-cffi 1,751 0.7.1 (2024-07-13 09:07:25 ago) Feb 23 2022 treq 605 25.5.0 (2025-06-03 03:42:30 ago) Dec 28 2012 hrequests 1,001 0.9.2 (2024-12-01 02:55:27 ago) Feb 23 2022 stealth curl-impersonate 5,944 v0.6.1 (2024-03-02 18:08:29 ago) Feb 23 2022 primp new 504 1.2.2 (2026-04-03 07:11:15 ago) Jun 01 2024 undetected-chromedriver 12,519 3.5.5 (2024-02-17 17:18:36 ago) Sep 04 2020 camoufox new 7,089 0.4.11 (2025-01-29 09:33:18 ago) Mar 01 2024 curl-cffi 1,751 0.7.1 (2024-07-13 09:07:25 ago) Feb 23 2022 nodriver new 4,003 0.48.1 (2025-11-09 05:57:23 ago) Jan 15 2024 botasaurus new 4,321 4.0.97 (2026-01-06 07:45:54 ago) Oct 01 2023 hrequests 1,001 0.9.2 (2024-12-01 02:55:27 ago) Feb 23 2022 selenium-driverless 718 1.9.4 (2024-10-22 01:41:19 ago) Jul 22 2022 pydoll new - 0.0.0 (2025-02-01 00:00:00 ago) Jun 01 2024 browser-automation selenium 34,072 4.43.0 (2026-04-10 06:47:01 ago) Apr 25 2008 playwright 14,506 1.58.0 (2026-01-30 15:09:24 ago) Feb 24 2021 browser-use new 87,251 0.12.6 (2026-04-02 07:55:13 ago) Nov 01 2024 undetected-chromedriver 12,519 3.5.5 (2024-02-17 17:18:36 ago) Sep 04 2020 camoufox new 7,089 0.4.11 (2025-01-29 09:33:18 ago) Mar 01 2024 nodriver new 4,003 0.48.1 (2025-11-09 05:57:23 ago) Jan 15 2024 skyvern new 21,046 1.0.29 (2026-04-02 14:42:44 ago) Feb 01 2024 requestium 1,837 0.5.1 (2026-01-19 16:59:35 ago) Dec 28 2012 selenium-driverless 718 1.9.4 (2024-10-22 01:41:19 ago) Jul 22 2022 splash 4,193 3.5 (2020-06-16 13:27:02 ago) Apr 25 2014 pydoll new - 0.0.0 (2025-02-01 00:00:00 ago) Jun 01 2024 framework scrapy 61,276 2.15.0 (2026-04-09 12:02:09 ago) Jul 26 2019 crawl4ai new 63,373 0.8.6 (2026-03-24 15:07:50 ago) May 01 2024 scrapling new 36,206 0.4.5 (2026-04-07 04:22:27 ago) Aug 01 2024 scrapegraphai new 23,278 1.76.0 (2026-04-09 09:41:03 ago) Jan 15 2024 scrapyd 3,087 1.6.0 (2025-07-22 06:00:53 ago) Sep 04 2013 botasaurus new 4,321 4.0.97 (2026-01-06 07:45:54 ago) Oct 01 2023 gracy 248 1.34.0 (2024-11-27 14:57:34 ago) Feb 05 2023 scrapydweb 3,400 1.6.0 (2025-02-16 13:18:50 ago) Sep 30 2018 photon 12,807 1.1.9 (2018-10-21 03:39:17 ago) Aug 24 2018 autoscraper 7,136 1.1.14 (2022-07-17 17:20:09 ago) Jul 26 2019 gerapy 3,495 0.9.13 (2023-07-19 18:53:46 ago) Jul 04 2017 ruia 1,743 0.8.5 (2022-09-06 08:54:56 ago) Oct 17 2018 dude 425 0.1.3 (2023-08-01 20:28:33 ago) Feb 20 2022 firecrawl new - 0.0.0 (2025-03-15 00:00:00 ago) Apr 01 2024 scrapy scrapy 61,276 2.15.0 (2026-04-09 12:02:09 ago) Jul 26 2019 scrapyd 3,087 1.6.0 (2025-07-22 06:00:53 ago) Sep 04 2013 scrapydweb 3,400 1.6.0 (2025-02-16 13:18:50 ago) Sep 30 2018 gerapy 3,495 0.9.13 (2023-07-19 18:53:46 ago) Jul 04 2017 splash 4,193 3.5 (2020-06-16 13:27:02 ago) Apr 25 2014 gui scrapydweb 3,400 1.6.0 (2025-02-16 13:18:50 ago) Sep 30 2018 gerapy 3,495 0.9.13 (2023-07-19 18:53:46 ago) Jul 04 2017 html-utils bleach 2,765 6.3.0 (2025-10-27 17:57:37 ago) Feb 21 2010 microformats extruct 961 0.18.0 (2024-11-08 14:59:22 ago) Oct 27 2015 html-extractor html2text 2,140 2025.4.15 (2025-04-15 04:02:28 ago) Dec 14 2008 trafilatura 5,650 2.0.0 (2024-12-03 15:23:21 ago) Jul 17 2019 readability 2,894 0.8.4.1 (2025-05-03 21:11:43 ago) Jun 30 2011 newspaper 15,018 0.2.8 (2018-09-28 04:58:18 ago) Dec 28 2012 extruct 961 0.18.0 (2024-11-08 14:59:22 ago) Oct 27 2015 sumy 3,670 0.12.0 (2026-02-14 21:00:12 ago) Oct 20 2013 photon 12,807 1.1.9 (2018-10-21 03:39:17 ago) Aug 24 2018 extractnet 297 2.0.7 (2022-11-06 07:33:14 ago) Dec 11 2020 captcha captcha_solver 255 0.1.5 (2019-03-01 21:41:21 ago) Feb 17 2015 unicaps 235 1.3.0 (2024-02-29 20:17:57 ago) Jul 27 2020 data jmespath 2,424 1.1.0 (2026-01-22 16:35:24 ago) Feb 09 2022 jsonpath-ng 728 1.8.0 (2026-02-28 00:53:19 ago) Feb 09 2022 xhtml2pdf 2,383 0.2.17 (2025-02-24 20:44:42 ago) May 19 2011 nested-lookup 209 0.2.25 (2022-07-06 18:55:03 ago) Feb 09 2022 json-parser jmespath 2,424 1.1.0 (2026-01-22 16:35:24 ago) Feb 09 2022 jsonpath-ng 728 1.8.0 (2026-02-28 00:53:19 ago) Feb 09 2022 nested-lookup 209 0.2.25 (2022-07-06 18:55:03 ago) Feb 09 2022 jmespath jmespath 2,424 1.1.0 (2026-01-22 16:35:24 ago) Feb 09 2022 text-parsing sumy 3,670 0.12.0 (2026-02-14 21:00:12 ago) Oct 20 2013 selenium selenium 34,072 4.43.0 (2026-04-10 06:47:01 ago) Apr 25 2008 undetected-chromedriver 12,519 3.5.5 (2024-02-17 17:18:36 ago) Sep 04 2020 requestium 1,837 0.5.1 (2026-01-19 16:59:35 ago) Dec 28 2012 selenium-driverless 718 1.9.4 (2024-10-22 01:41:19 ago) Jul 22 2022 html-parser lxml 3,010 6.0.3 (2026-04-09 14:33:38 ago) Dec 13 2022 beautifulsoup - 4.14.3 (2025-11-30 15:08:24 ago) Jul 26 2019 xmltodict 5,734 1.0.4 (2026-02-22 02:21:21 ago) Jul 30 2007 html5lib 1,220 1.1 (2020-06-22 23:32:36 ago) Jul 30 2007 cssselect 309 1.4.0 (2026-01-29 07:00:24 ago) Apr 14 2012 feedparser 2,351 6.0.12 (2025-09-10 13:33:58 ago) Jun 15 2007 parsel 1,324 1.11.0 (2026-01-29 07:19:22 ago) Jul 26 2019 selectolax 1,607 0.4.7 (2026-03-06 09:23:35 ago) Mar 01 2018 pyquery 2,381 2.0.1 (2024-08-30 08:12:22 ago) Dec 05 2008 requests-html 13,863 0.10.0 (2019-02-17 20:14:17 ago) Feb 25 2018 untangle 632 1.2.1 (2022-07-02 14:09:28 ago) Jun 09 2011 scrapling new 36,206 0.4.5 (2026-04-07 04:22:27 ago) Aug 01 2024 chompjs 218 1.4.0 (2025-08-04 21:07:54 ago) Jul 30 2007 html5-parser 700 0.4.12 (2023-11-19 15:09:54 ago) Jun 03 2007 gazpacho 768 1.1 (2020-10-09 12:50:18 ago) Dec 28 2012 chopper 23 0.6.0 (2023-04-26 10:16:25 ago) Jul 24 2014 css cssutils 90 2.11.1 (2024-06-04 15:51:37 ago) Aug 04 2007 data-output xhtml2pdf 2,383 0.2.17 (2025-02-24 20:44:42 ago) May 19 2011 http-utils httptools 1,316 0.7.1 (2025-10-10 03:54:20 ago) Dec 28 2012 requests-cache 1,486 1.3.1 (2026-03-04 18:05:49 ago) Feb 14 2011 scrapers crosslinked 1,493 0.3.0 (2023-06-19 14:10:42 ago) Feb 14 2011 playwright playwright 14,506 1.58.0 (2026-01-30 15:09:24 ago) Feb 24 2021 jsonpath jsonpath-ng 728 1.8.0 (2026-02-28 00:53:19 ago) Feb 09 2022 ai browser-use new 87,251 0.12.6 (2026-04-02 07:55:13 ago) Nov 01 2024 crawl4ai new 63,373 0.8.6 (2026-03-24 15:07:50 ago) May 01 2024 skyvern new 21,046 1.0.29 (2026-04-02 14:42:44 ago) Feb 01 2024 scrapegraphai new 23,278 1.76.0 (2026-04-09 09:41:03 ago) Jan 15 2024 firecrawl new - 0.0.0 (2025-03-15 00:00:00 ago) Apr 01 2024 headers ua-parser 641 1.0.1 (2025-02-01 14:13:28 ago) Dec 29 2012 blocking ua-parser 641 1.0.1 (2025-02-01 14:13:28 ago) Dec 29 2012 cloudscraper 6,431 1.2.71 (2023-04-25 23:20:15 ago) Dec 28 2012 http ua-parser 641 1.0.1 (2025-02-01 14:13:28 ago) Dec 29 2012 seo advertools 1,372 0.17.2 (2026-04-02 13:40:34 ago) Dec 28 2012 scraping-api zenrows new 18 1.4.0 (2024-11-13 14:49:00 ago) Jun 01 2022 firecrawl new - 0.0.0 (2025-03-15 00:00:00 ago) Apr 01 2024 Was this page helpful? Thanks for your feedback! Thanks for your feedback! Feel free to email suggestions to hello@webscraping.fyi