PyRank

Web Scraping Python Python Packages

Python packages with the GitHub topic web-scraping-python. Sorted by relevance, with stars and monthly downloads.
scrapy
scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

3.8M 62K 12K
D4Vinci
scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

893K 50K 5K
ScrapeGraphAI
scrapegraph-py

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction

314K 76 14
thewebscraping
wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

86K 155 13
omkarcloud
botasaurus

The All in One Framework to Build Undefeatable Scrapers

37K 5K 424
omkarcloud
bota

The All in One Framework to Build Undefeatable Scrapers

30K 5K 424
omkarcloud
javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

28K 5K 424
omkarcloud
botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

28K 5K 424
arman-bd
httpmorph

httpmorph is a drop-in replacement for Python's requests library that uses a custom C implementation with BoringSSL instead of Python's standard HTTP stack.

9K 146 3
omkarcloud
botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

3K 5K 424
rayobyte-data
rayobrowse

Stealth Chromium browser for web scraping and AI agents.

1K 164 8
ParallaxAPIs
parallaxapis-sdk-py

ParallaxAPIs SDK

727 68 0
TomTkacz
gli99

Web scraper for gifcities.org

681 4 0
omkarcloud
bose

The Ultimate Web Scraping Framework

638 4K 385
scrapy
aminer-scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

632 62K 12K
indrajithi
tiny-web-crawler

A simple and easy to use web crawler for Python

589 64 11
GoncaloMark
cobweb-lnx

CobWeb is a Python library for web scraping. The library consists of two classes: Spider and Scraper.

386 39 2
irfanalidv
trustpilot-scraper

A Python library for scraping Trustpilot reviews.

335 22 10
jsem-nerad
strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

323 3 0
DevEnterpriseSoftware
scrapi-sdk

The only web scraping service you'll ever need that offers advanced features that are simple to use for efficient data extraction.

255 1 0
crawlcore
qcrawl

Fast async web crawler & scraping framework, supporting deduplication, and extensible middleware.

237 109 5
mike-gee
webtranspose

Web scraping API for building AI applications.

236 40 2
scrapy
bf-scrapy-base

基于scrapy的二次开发

226 62K 12K
scrapy
scrapy-qfm

Scrapy, a fast high-level web crawling & scraping framework for Python.

218 62K 12K