Webscraping Python Packages

requests-cache

Persistent HTTP cache for python requests

htmldate

Fast and robust date extraction from web pages, with Python or on the command-line

firecrawl-py

🔥 Search, scrape, and clean the web for AI agents.

patchright

Undetected Python version of the Playwright testing and automation library.

seleniumbase

APIs for browser automation, testing, and bypassing bot-detection.

firecrawl

🔥 Search, scrape, and clean the web for AI agents.

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

camoufox

🦊 Anti-detect browser

cloakbrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

zenrows

SDK to access ZenRows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.

gpt-researcher

An autonomous agent that conducts deep research on any data using any LLM providers

stealth-requests

Undetected web-scraping & seamless HTML parsing in Python!

libzim

Libzim binding for Python: read/write ZIM files in Python

selenium-base

APIs for browser automation, testing, and bypassing bot-detection.

pytest-seleniumbase

APIs for browser automation, testing, and bypassing bot-detection.

sbase

APIs for browser automation, testing, and bypassing bot-detection.

pytest-sbase

APIs for browser automation, testing, and bypassing bot-detection.

homeharvest

Python package for scraping real estate property data

hyper-sdk

Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.

basecase

APIs for browser automation, testing, and bypassing bot-detection.

scrapingant-client

ScrapingAnt API client for Python.

ssc-codegen

python-dsl code converter to html parser for web scraping

gazpacho

The simple, fast, and modern web scraping library

aniworld

AniWorld Downloader is a cross-platform tool for streaming and downloading anime from aniworld.to, as well as series from s.to. It runs on Windows, macOS, and Linux, providing a seamless experience for offline viewing or instant playback. If you enjoy using it, feel free to leave a ⭐!