playwrightvsselenium-driverless
playwright is a Python package that allows developers to automate web browsers for end-to-end testing, web scraping, and web performance analysis. It is built on top of WebKit, Mozilla's Gecko, and Microsoft's EdgeHTML, and it is designed to be fast, reliable, and easy to use.
playwright is similar to Selenium, but it provides a more modern and powerful API, with features such as automatic waiting for elements, automatic retries, and built-in support for browser contexts, which allow you to open multiple pages in a single browser instance.
Playwright also provides an asynchronous client which makes scaling playwright-powered web scrapers easier than alternatives (like Selenium)
Selenium Driverless is a Selenium inspired browser automation library with focus on web scraping detection bypass. It shares most of Selenium API and UX but implements several extensions that make the scraper more difficult to detect and extra usability features like: - Bypass Cloudflare - Multiple Tab scraping - Multiple context support - Proxy auth - Network interception
Example Use
from playwright import sync_playwright
# Start Playwright
with sync_playwright() as playwright:
# Launch a browser instance
browser = playwright.chromium.launch()
# Open a new context (tab)
context = browser.new_context()
# Create a new page in the context
page = context.new_page()
# Navigate to a website
page.goto("https://www.example.com")
# Find an element by its id
element = page.get_by_id("example-id")
# Interact with the element
element.click()
# Fill an input form
page.get_by_name("example-name").fill("example text")
# Find and click a button
page.get_by_xpath("//button[text()='Search']").click()
# Wait for the page to load
page.wait_for_selector("#results")
# Get the page title
print(page.title)
# Close the browser
browser.close()
# It works the same as Selenium just with a different import.
import undetected_chromedriver as uc
driver = uc.Chrome(headless=True, use_subprocess=False)
driver.get('https://nowsecure.nl')
driver.save_screenshot('screenshot.png')
driver.close()