Scraping Framework Python Packages

requests-html

Pythonic HTML Parsing for Humans™

botasaurus

The All in One Framework to Build Undefeatable Scrapers

bota

The All in One Framework to Build Undefeatable Scrapers

javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

async-tls-client

Async fork of Python-TLS-Client with modern asyncio support, updated dependencies, and fixes for issues in the original abandoned library. Includes enhanced compatibility, stability improvements, and ongoing maintenance for Python 3.9–3.13.

memorious

Lightweight web scraping toolkit for documents and structured data.

scrappey

Official Python wrapper for Scrappey.com - Web scraping API ready for LLM's and browser automation

botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

bose

The All in One Framework to Build Undefeatable Scrapers

minigun

Web scraping API to outsource tons of GET & xpath to cloud computing

scrappeycom

An API wrapper for Scrappey.com written in Python

scrapeflow-py

An opinionated scraping workflow engine built on Playwright

sneakpeek-py

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

pg-cache-storage

PostgreSQL cache storage for botasaurus.

sqlite-cache-storage

SQLite cache storage for botasaurus.