PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Web Scraping Python Python Packages

Python packages with the GitHub topic web-scraping-python. Sorted by relevance, with stars and monthly downloads.
scrapy
scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

6.2M 63K 12K
arman-bd
httpmorph

httpmorph is a drop-in replacement for Python's requests library that uses a custom C implementation with BoringSSL instead of Python's standard HTTP stack.

1.2M 149 4
D4Vinci
scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

797K 68K 7K
ScrapeGraphAI
scrapegraph-py

Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction

292K 80 16
thewebscraping
wrapper-tls-requests

TLS Requests is a powerful Python library for secure HTTP requests, offering browser-like TLS client, fingerprinting, anti-bot page bypass, and high performance.

112K 159 13
omkarcloud
botasaurus

The All in One Framework to Build Undefeatable Scrapers

23K 6K 485
omkarcloud
bota

The All in One Framework to Build Undefeatable Scrapers

23K 6K 485
omkarcloud
javascript-fixes

The All in One Framework to Build Undefeatable Scrapers

22K 6K 485
omkarcloud
botasaurus-humancursor

The All in One Framework to Build Undefeatable Scrapers

21K 6K 485
ParallaxAPIs
parallaxapis-sdk-py

ParallaxAPIs SDK

1K 73 0
omkarcloud
botasaurus-server

The All in One Framework to Build Undefeatable Scrapers

884 6K 485
crawlcore
qcrawl

qcrawl - fast async web crawling & scraping framework for Python.

834 110 6
TomTkacz
gli99

Web scraper for gifcities.org

806 4 0
scrapy
aminer-scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

631 63K 12K
rayobyte-data
rayobrowse

Stealth Chromium browser for web scraping and AI agents.

506 184 12
omkarcloud
bose

The All in One Framework to Build Undefeatable Scrapers

471 6K 484
indrajithi
tiny-web-crawler

A simple and easy to use web crawler for Python

358 65 11
jsem-nerad
strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

354 3 0
GoncaloMark
cobweb-lnx

CobWeb is a Python library for web scraping. The library consists of two classes: Spider and Scraper.

325 39 2
irfanalidv
trustpilot-scraper

A Python library for scraping Trustpilot reviews.

311 21 10
scrapy
bf-scrapy-base

Scrapy, a fast high-level web crawling & scraping framework for Python.

304 63K 12K
mike-gee
webtranspose

Web scraping API for building AI applications.

247 40 2
gnramsay
oots-get

Command-line Python package to download all the comic images for the "Order of the Stick" webcomic. Uses the 'Beautiful Soup' package for web-scraping.

235 1 1
DevEnterpriseSoftware
scrapi-sdk

Official Python SDK for the ScrAPI web scraping service.

232 1 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery