Skip to content

splash

4,008 15 402 BSD
3.5 (16 Jun 2020) Apr 25 2014 581 (month)

Splash is a javascript rendering service with an HTTP API. It's a lightweight browser with an HTTP API, implemented in Python 3 using Twisted and QT5.

It is built on top of the QtWebkit library and allows developers to interact with web pages in a headless mode, which means that the web pages are rendered in the background, without displaying them on the screen.

splash is particularly useful for web scraping and web testing tasks, as it allows developers to interact with web pages in a way that is very similar to how a human user would interact with the browser.

It also allows you to execute javascript and interact with web pages even if they use heavy javascript.

Unlike Selenium or Playwright, splash is powered by webkit embedded browser instead of a real browser like Chrome or Firefox. As a down-side splash requests are easy to detect and block when scraping websites with anti-scraping features.

One benefit of splash is that it seemlesly integrates with Scrapy.

Example Use


# once splash server is started it can be requested to render pages through 
# HTTP requests:
import requests

url = "http://localhost:8050/render.html"
payload = {
    'url': 'https://www.example.com',
    'timeout': 30,
    'wait': 2
}

response = requests.get(url, params=payload)

# Get the page HTML
print(response.text)

Alternatives / Similar


29,399 4.20.0 (17 days ago) Apr 25 2008 compare
10,799 1.43.0 (a month ago) Feb 24 2021 compare
51,043 2.11.1 (2 months ago) Jul 26 2019 compare
1,816 0.4.0 (3 months ago) Dec 28 2012 compare
2,857 1.4.3 (7 months ago) Sep 04 2013 compare
3,012 1.5.0 (2 months ago) Sep 30 2018 compare
3,219 0.9.13 (9 months ago) Jul 04 2017 compare

Other Languages

10,325 chromedp (9 months ago) Aug 15 2019 compare
2,891 v2.1.1 (5 months ago) Jul 17 2018 compare