Scraping Framework Python Packages

requests-html

Pythonic HTML Parsing for Humans™

botasaurus

The All in One Framework to Build Undefeatable Scrapers

bota

The All in One Framework to Build Undefeatable Scrapers

javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

async-tls-client

Async fork of Python-TLS-Client with modern asyncio support, updated dependencies, and fixes for issues in the original abandoned library. Includes enhanced compatibility, stability improvements, and ongoing maintenance for Python 3.9–3.13.

botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

memorious

A minimalistic, recursive web crawling library for Python.

bose

The Ultimate Web Scraping Framework

minigun

Web scraping API to outsource tons of GET & xpath to cloud computing

scrappeycom

An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)

sneakpeek-py

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant basis

scrappey

An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)

scrapeflow-py

An opinionated scraping workflow engine built on Playwright

pg-cache-storage

The All in One Framework to Build Undefeatable Scrapers

sqlite-cache-storage

The All in One Framework to Build Undefeatable Scrapers