PyRank

Web Scraper Python Packages

Python packages with the GitHub topic web-scraper. Sorted by relevance, with stars and monthly downloads.
firecrawl
firecrawl-py

🔥 Search, scrape, and clean the web for AI agents.

6.8M 121K 7K
firecrawl
firecrawl

🔥 Search, scrape, and clean the web for AI agents.

971K 121K 7K
D4Vinci
scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

881K 50K 5K
lncrawl
lightnovel-crawler

Generate and download e-books from online sources.

8K 2K 456
jaebradley
basketball-reference-web-scraper

NBA Stats API via Basketball Reference

8K 545 130
dcstats
cbbpy

A Python-based web scraper for NCAA basketball.

6K 28 7
us
crw

Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

6K 89 5
a-luna
vigorish

MLB data web scraper, Python CLI application

1K 2 2
shaikhsajid1111
facebook-page-scraper

Scrapes facebook's pages front end with no limitations & provides a feature to turn data into structured JSON or CSV

1K 269 82
svdC1
scrape-do-python

Python SDK for the Scrape.do web-scraping proxy API — type-checked requests, auto-retries, sticky sessions, event hooks

1K 0 0
AVS1508
cbse-results-scraper

CBSE-Results-Scraper is a command-line Python application that scrapes and downloads student reports of CBSE (Central Board of Secondary Education) Class XII Results 2019 from http://cbseresults.nic.in.

1K 2 3
SenZmaKi
senpwai

A desktop app for tracking and batch downloading anime

801 321 50
paulpierre
markdown-crawler

A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG

763 442 54
TomTkacz
gli99

Web scraper for gifcities.org

726 4 0
areed1192
python-sec

A simple python library that allows for easy access of the SEC website so that someone can parse filings, collect data, and query documents.

708 128 49
anirbanbasu
ollama-downloader

A library and Hugging Face model downloader for Ollama.

706 5 1
JacobLee23
sabrmetrics

A web scraper for SABRmetrics websites

511 5 0
ryanirl
craigslistscraper

Simple webscraper for Craigslist.

493 55 23
khuyentran1401
top-github-scraper

Scape top GitHub repositories and users based on keywords

472 88 25
j4asper
dmr-py

Pull data directly from the danish vehicle register with dmr.py

466 12 1
azogue
esiosdata

Web Scraper para datos de demanda, producción y coste de la energía eléctrica en España, y simulador de facturación eléctrica según el PVPC..

423 19 6
YashTotale
goodreads-user-scraper

Scrape user data from Goodreads

406 12 6
ankitmathur3193
song

A script to download hindi and punjabi songs from internet

402 61 13
GoncaloMark
cobweb-lnx

CobWeb is a Python library for web scraping. The library consists of two classes: Spider and Scraper.

380 39 2