Skip to content

photon

13,346 3 61 GPL-3.0
1.1.9 (21 Oct 2018) Aug 24 2018 986 (month)

Photon is a Python library for web scraping. It is designed to be lightweight and fast, and can be used to extract data from websites and web pages. Photon can extract the following data while crawling:

  • URLs (in-scope & out-of-scope)
  • URLs with parameters (example.com/gallery.php?id=2)
  • Intel (emails, social media accounts, amazon buckets etc.)
  • Files (pdf, png, xml etc.)
  • Secret keys (auth/API keys & hashes)
  • JavaScript files & Endpoints present in them
  • Strings matching custom regex pattern
  • Subdomains & DNS related data

The extracted information is saved in an organized manner or can be exported as json.

Example Use


from photon import Photon

#Create a new Photon instance
ph = Photon()

#Extract data from a specific element of the website
url = "https://www.example.com"
selector = "div.main"
data = ph.get_data(url, selector)

#Print the extracted data
print(data)


#Extract data from multiple websites asynchronously
urls = ["https://www.example1.com", "https://www.example2.com"]
data = ph.get_data_async(urls)

Alternatives / Similar


7,128 2.3.1 (2026-10-06 19:30:24 ago) Jul 17 2019 compare
2,174 2025.4.15 (2025-04-15 04:02:28 ago) Dec 14 2008 compare
201,818 4.57.0 (2026-11-12 15:19:02 ago) Apr 01 2024 compare
65,141 2.19.0 (2026-09-10 11:14:18 ago) Jul 26 2019 compare
2,891 0.9 (2026-08-27 19:29:58 ago) Jun 30 2011 compare
87,360 0.9.5 (2026-10-14 10:25:32 ago) May 01 2024 compare
102,927 0.5.1 (2026-11-04 20:29:38 ago) Aug 01 2024 compare
984 0.18.0 (2024-11-08 14:59:22 ago) Oct 27 2015 compare
15,187 0.2.8 (2018-09-28 04:58:18 ago) Dec 28 2012 compare
3,701 0.13.0 (2026-08-12 20:47:22 ago) Oct 20 2013 compare
5,842 4.0.97 (2026-01-06 07:45:54 ago) Oct 01 2023 compare
3,099 1.6.0 (2025-07-22 06:00:53 ago) Sep 04 2013 compare
32,783 2.3.1 (2026-10-06 08:27:56 ago) Jan 15 2024 compare
247 1.34.0 (2024-11-27 14:57:34 ago) Feb 05 2023 compare
8,090 1.1.14 (2022-07-17 17:20:09 ago) Jul 26 2019 compare
3,411 1.6.0 (2025-02-16 13:18:50 ago) Sep 30 2018 compare
1,738 0.8.5 (2022-09-06 08:54:56 ago) Oct 17 2018 compare
3,517 0.9.13 (2023-07-19 18:53:46 ago) Jul 04 2017 compare
302 2.0.7 (2022-11-06 07:33:14 ago) Dec 11 2020 compare
428 0.1.3 (2023-08-01 20:28:33 ago) Feb 20 2022 compare

Other Languages

25,597 v2.2.0 (2025-03-27 10:47:28 ago) May 14 2018 compare
17,845 v1.8.0 (2026-10-05 13:28:18 ago) Nov 07 2022 compare
7,584 v1.4.0 (2026-03-03 03:58:32 ago) Feb 15 2020 compare
2,783 2026-11-13 (2026-11-13 06:19:33 ago) Jun 06 2019 compare
716 2026-11-10 (2026-11-10 11:36:17 ago) Feb 09 2017 compare
26,447 3.18.2 (2026-11-13 21:59:55 ago) Apr 22 2022 compare
1,525 1.0.5 (2026-07-09 06:54:00 ago) Nov 22 2014 compare
4,444 2.14.2 (2026-10-26 20:34:30 ago) Jul 25 2009 compare
2,052 (2021-05-19 15:14:49 ago) Nov 20 2016 compare
2,879 v1.5.0 (2026-09-25 03:00:53 ago) Apr 20 2016 compare
6,024 v2.0.0-alpha.62 (2026-11-02 17:33:11 ago) Jul 15 compare
3,072 v2.4.0 (2026-01-08 05:29:21 ago) Jul 17 2018 compare
6,798 2.1.1 (2026-10-24 07:58:18 ago) Sep 10 2012 compare
9,168 v4.0.3 (2023-04-01 09:05:33 ago) Dec 02 2012 compare
- 2.2.0 (2026-01-27 17:36:19 ago) Aug 23 2018 compare
836 0.7.2 (2025-02-03 07:58:27 ago) Jul 25 2009 compare
1,361 3.4.0 (2026-10-27 16:48:25 ago) Dec 27 2011 compare
1,456 v3.2.1 (2025-03-21 06:53:36 ago) Dec 27 2021 compare
165 2.3.0 (2026-07-09 06:48:00 ago) Dec 22 2019 compare
589 3.0.0 (2024-04-09 15:34:59 ago) May 04 2020 compare
215 1.0.0-beta8.4 (2023-06-29 12:37:12 ago) Apr 18 2019 compare
1,339 v0.7.7 (2026-08-04 16:21:12 ago) Mar 16 2013 compare
374 v3.5.8 (2026-05-03 06:50:54 ago) Apr 18 2022 compare
Was this page helpful?