Web Scraping Python Python Packages

scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

seleniumbase

📊 API for Browser Automation, E2E Testing, and Web Scraping. CDP Mode is undetectable by anti-bot systems. Makes Playwright stealthy.

scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

scrapegraph-py

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction

wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

pytest-sbase

📊 API for Browser Automation, E2E Testing, and Web Scraping. CDP Mode is undetectable by anti-bot systems. Makes Playwright stealthy.

pytest-seleniumbase

📊 API for Browser Automation, E2E Testing, and Web Scraping. CDP Mode is undetectable by anti-bot systems. Makes Playwright stealthy.

sbase

📊 API for Browser Automation, E2E Testing, and Web Scraping. CDP Mode is undetectable by anti-bot systems. Makes Playwright stealthy.

selenium-base

Framework for Browser Automation, Web Scraping, and Testing. CDP Mode is undetectable to anti-bot systems and adds stealth to stock Playwright.

javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

botasaurus

The All in One Framework to Build Undefeatable Scrapers

botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

bota

The All in One Framework to Build Undefeatable Scrapers

basecase

Framework for Browser Automation, Web Scraping, and Testing. CDP Mode is undetectable to anti-bot systems and adds stealth to stock Playwright.

httpmorph

httpmorph is a drop-in replacement for Python's requests library that uses a custom C implementation with BoringSSL instead of Python's standard HTTP stack.

cnkibug

中国知网论文信息批量爬取工具｜GUI / Python CLI｜CNKI crawler & metadata scraper

slybrowser

Free pro anti-detect browser with 27 fingerprint groups and Native Humanize. Stealth browser automation and web scraping. Chromium based.

botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

hexium-browser

Stealth antidetect browser for Playwright — patched Chromium 151 with C++ persona, persistent profiles, humanize & GeoIP. launch() in, Chrome out.

parallaxapis-sdk-py

ParallaxAPIs SDK

decodo-sdk

Decodo Python SDK is an official Python client for the Decodo Web Scraping API. Typed, validated targets with IDE autocomplete, covering Google, Amazon, TikTok, ChatGPT, and 50+ more.

gli99

Web scraper for gifcities.org

strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

aminer-scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.