nodrivervsrod

AGPL-3.0 14 2 4,003

321.9 thousand (month) Jan 15 2024 0.48.1(2025-11-09 05:57:23 ago)

6,853 3 202 MIT

Sep 23 2022 v0.116.2(2024-07-12 11:52:28 ago)

nodriver is a Python library for browser automation that communicates directly with the browser via the Chrome DevTools Protocol (CDP), without relying on Selenium or chromedriver. It is the successor to undetected-chromedriver, created by the same author, and is designed from the ground up to be undetectable by anti-bot systems.

Key advantages over traditional browser automation:

No chromedriver dependency Communicates directly with Chrome/Chromium via CDP websocket, eliminating the most common detection vector (chromedriver fingerprint).
Undetectable by default Does not set the navigator.webdriver flag, does not inject automation-related JavaScript, and avoids CDP detection patterns that anti-bot systems look for.
Fast and lightweight Without the Selenium/WebDriver protocol overhead, nodriver is significantly faster at launching browsers and executing commands.
Async-first Built entirely on Python's asyncio, enabling efficient concurrent browser automation.
Simple API Clean, Pythonic API that is easier to use than raw CDP or Selenium.

nodriver is particularly useful for scraping websites protected by advanced anti-bot systems like Cloudflare, DataDome, or PerimeterX, where standard Selenium or Playwright setups get detected and blocked.

Rod is a high-level Go library for browser automation built on the Chrome DevTools Protocol (CDP). It provides a simpler and more intuitive API compared to chromedp, making it easier to write browser automation and web scraping scripts in Go.

Key features include:

Simple API Rod's API is designed to be intuitive and requires less boilerplate than chromedp. Common operations like clicking, typing, and waiting are straightforward single-line calls.
Auto-wait Automatically waits for elements to be ready before interacting with them, reducing the need for explicit wait statements and making scripts more reliable.
Page pool Built-in page pool for managing multiple browser pages efficiently, useful for concurrent scraping tasks.
Stealth mode Includes a stealth plugin (rod/lib/launcher/flags) that can disable common automation detection vectors.
Element screenshots Can take screenshots of specific elements, not just full pages.
Network interception Supports hijacking network requests and responses for modification or monitoring.
Input emulation Realistic mouse and keyboard input emulation for interacting with complex web applications.

Rod is the recommended choice for new Go browser automation projects due to its simpler API and active maintenance. It is comparable to Playwright in terms of developer experience but native to the Go ecosystem.

Highlights

anti-detectcdpasyncfast

cdpfast

Example Use

```python import nodriver as uc import asyncio async def main(): # Launch browser - undetected by default browser = await uc.start() # Open a new tab and navigate tab = await browser.get("https://example.com") # Wait for an element and interact with it search_box = await tab.find("input[name='q']") await search_box.send_keys("web scraping") # Click a button button = await tab.find("button[type='submit']") await button.click() # Wait for navigation and extract content await tab.wait_for("div.results") results = await tab.query_selector_all("div.result") for result in results: title = await result.query_selector("h3") print(await title.get_text()) # Take a screenshot await tab.save_screenshot("results.png") browser.stop() asyncio.run(main()) ```

```go package main import ( "fmt" "github.com/go-rod/rod" "github.com/go-rod/rod/lib/launcher" ) func main() { // Launch browser url := launcher.New().Headless(true).MustLaunch() browser := rod.New().ControlURL(url).MustConnect() defer browser.MustClose() // Navigate and auto-wait for the page to load page := browser.MustPage("https://example.com") page.MustWaitStable() // Find elements and extract text - auto-waits for element title := page.MustElement("h1").MustText() fmt.Println("Title:", title) // Fill in a form page.MustElement("input[name='search']").MustInput("web scraping") page.MustElement("button[type='submit']").MustClick() // Wait for results and extract page.MustWaitStable() results := page.MustElements(".result-item") for _, el := range results { text := el.MustText() href := el.MustElement("a").MustProperty("href").String() fmt.Printf("Result: %s (%s)\n", text, href) } // Take screenshot of specific element page.MustElement(".results").MustScreenshot("results.png") } ```