Webscraping Python Packages

requests-cache

Persistent HTTP cache for python requests

htmldate

Fast and robust date extraction from web pages, with Python or on the command-line

firecrawl-py

The API to search, scrape, and interact with the web at scale. 🔥

patchright

Undetected Python version of the Playwright testing and automation library.

seleniumbase

📊 APIs for web automation, testing, and bypassing bot-detection.

camoufox

🦊 Anti-detect browser

firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

cloakbrowser

Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.

zenrows

SDK to access ZenRows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.

gpt-researcher

An autonomous agent that conducts deep research on any data using any LLM providers

stealth-requests

Undetected web-scraping & seamless HTML parsing in Python!

libzim

Libzim binding for Python: read/write ZIM files in Python

pytest-seleniumbase

📊 APIs for web automation, testing, and bypassing bot-detection.

selenium-base

📊 APIs for web automation, testing, and bypassing bot-detection.

sbase

📊 APIs for web automation, testing, and bypassing bot-detection.

pytest-sbase

📊 APIs for web automation, testing, and bypassing bot-detection.

homeharvest

Python package for scraping real estate property data

basecase

📊 APIs for web automation, testing, and bypassing bot-detection.

hyper-sdk

Python SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.

scrapingant-client

ScrapingAnt API client for Python.

aniworld

AniWorld Downloader is a cross-platform tool for streaming and downloading content from AniWorld, SerienStream, MegaKino, and Hanime, with more support coming in the future. It runs on Windows, macOS, and Linux. If you enjoy using it, feel free to leave a ⭐!

kameleo-local-api-client

Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates with Selenium, Playwright, and Puppeteer via SDKs in Python, JavaScript, and C#.

zimscraperlib

Collection of Python code to re-use across Python-based scrapers