PyRank

Webscraper Python Packages

Python packages with the GitHub topic webscraper. Sorted by relevance, with stars and monthly downloads.
nmcassa
letterboxdpy

A letterboxd webscraper

15K 169 31
EchterAlsFake
phub

A lightweight API for Pornhub

5K 152 38
foreandr
hypersel

HyperSel is a Python-based framework for web automation and data scraping. It simplifies crawling, automating interactions, and data extraction from web pages. It is built with various robust tools to handle dynamic and complex web interactions efficiently, offering features such as headless browsing, proxy support, and API sniffing.

3K 2 0
HelloThereMatey
tedata

Scraper for Trading Economics

2K 34 9
tyleracorn
covid-alberta

looking at some of the alberta specific covid data

1K 1 0
square-box-hash
srag

Smart RAG — the retrieval layer for local AI agents. Replaces Tavily + Firecrawl + Perplexity with a single open-source package.

1K 2 0
sayedshaun
onecrawler

An async python crawling framework for discovering URLs, extracting links, and scraping structured content.

1K 1 0
HimashaHerath
llm-webextract

AI-powered web content extraction — turn any website into structured JSON using LLMs and LangChain

1K 2 0
MichaelYochpaz
isubrip

A Python package for scraping and downloading subtitles from AppleTV / iTunes movie pages.

952 211 23
toby-p
rightmove-webscraper

A class for scraping data from rightmove.co.uk

934 280 121
rootVIII
proxy-requests

a class that uses scraped proxies to make http GET/POST requests (Python requests)

930 387 43
imyourboyroy
web-scraper-toolkit

AI-first web scraping engine with stealth bypass, MCP server, and multimodal output (Markdown, JSON, PDF) for agents and automation.

840 5 2
xtream1101
scraperx

ScraperX SDK

700 54 11
eugen1j
aioscrapy

Python asynchronous library for web scraping

665 12 3
vypivshiy
scrape-schema

Structuring parsed data into python objects

656 4 1
GeminidSystems
googlenewsscraper

Scrapes Google News article data

642 12 5
JonathanVusich
pcpartpicker

A fast, simple API for PCPartPicker.com.

604 120 12
mrwan200
pytwitterscraper

Twitter Scraper With Python

530 12 3
ishan-surana
metadatascraper

A module designed to automate the extraction of follower counts and post details from a public Facebook page.

527 13 1
brandonrobertz
autoscrape

An automated, programming-free web scraper for interactive sites

520 112 20
thicccat688
mintospy

No description available

509 9 4
zduclos
artvee-scraper

Scrape public domain artwork from https://www.artvee.com

457 11 2
JaonHax
scpscraper

A Python library designed for scraping data from the SCP wiki.

450 16 4
jtara1
imgur-downloader

Python script/class to download an entire Imgur album in one go into a folder of your choice.

427 40 7