Headless Browser Python Packages

scrapy-playwright

🎭 Playwright integration for Scrapy

cloakbrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

html2image

A package acting as a wrapper around the headless mode of existing web browsers to generate images from URLs and from HTML+CSS strings or files.

scrapfly-sdk

Official Python SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Integrates with Scrapy, LlamaIndex, and LangChain.

abx-plugins

🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...

archivebox

🗃 Open source self-hosted web archiving. Takes URLs/browser history/bookmarks/Pocket/Pinboard/etc., saves HTML, JS, PDFs, media, and more...

phasma

Playwright-like async API for PhantomJS — pip install only, no apt, no npm, no Chrome.

shardx

Free, open-source anti-detect browser launcher for web scraping and multi-accounting. By the ProxyShard team. Engine-level fingerprint spoofing in Chromium 148 (WebGL / WebGPU / Client Hints / fonts / TLS), 170+ device profiles bundled, stable QUIC + WebRTC over SOCKS5.

colorsense

Extract the rendered color palette from any website as a typed result.

ghostcrawl

Authentic, reliable web data at scale — real Chrome, Firefox & WebKit browsers in the cloud. Crawl, scrape, extract & automate via API, SDKs, and MCP. Self-host free or use the managed cloud.

tilion-fortress

Stealth Chromium engine that stops scrapers and browser agents from getting blocked, with one line of code change.

veilrender

Headless browser rendering API — self-hostable on HF Spaces, Docker, or bare metal

browser-oxide

Stealth headless browser engine in Rust — native BoringSSL TLS/JA4 fingerprint, real JS via deno_core, no Chromium, no CDP. Python + MCP bindings. A camoufox alternative.

rayobrowse

Stealth Chromium browser for web scraping and AI agents.

ember-browser

Lightweight headless browser for AI agents

conduit-browser

Headless browser with SHA-256 hash chain + Ed25519 audit trails. MCP server for AI agents. Stealth. Self-verifiable proof bundles.

scrapy-pyppeteer

Pyppeteer integration for Scrapy

scrapy-playwright-full

🎭 Playwright integration for Scrapy

cf-killer

Cloudflare 5s 盾自动求解 + 页面批量抓取工具（基于 CloakBrowser）

plasmate

The browser engine for agents. HTML in, Semantic Object Model out. 10x token compression, V8 JS rendering, CDP compatible. Apache-2.0.

archivebox-likn

The self-hosted internet archive.

plasmate-browser-use

Plasmate SOM integration for Browser Use - 10x fewer tokens for AI web agents

scrapy-scraper

Web crawler and scraper based on Scrapy and Playwright's headless browser.

som-parser

The browser engine for agents. HTML in, Semantic Object Model out. 10x token compression, V8 JS rendering, CDP compatible. Apache-2.0.