Headless Browser Python Packages

scrapy-playwright

🎭 Playwright integration for Scrapy

html2image

A package acting as a wrapper around the headless mode of existing web browsers to generate images from URLs and from HTML+CSS strings or files.

scrapfly-sdk

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

cloakbrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

abx-plugins

🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...

archivebox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

rayobrowse

Stealth Chromium browser for web scraping and AI agents.

scrapy-pyppeteer

Pyppeteer integration for Scrapy

scrapy-playwright-full

🎭 Playwright integration for Scrapy

plasmate

Agent-native headless browser. HTML in, Semantic Object Model out.

conduit-browser

Headless browser with SHA-256 hash chain + Ed25519 audit trails. MCP server for AI agents. Stealth. Self-verifiable proof bundles.

archivebox-likn

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

plasmate-browser-use

The browser engine for agents. HTML in, Semantic Object Model out. 10x token compression, V8 JS rendering, CDP compatible. Apache-2.0.

scrapy-scraper

Web crawler and scraper based on Scrapy and Playwright's headless browser.

som-parser

Parse and query SOM (Semantic Object Model) - the structured web format for AI agents