PyRank

Webscraper Python Packages

Python packages with the GitHub topic webscraper. Sorted by relevance, with stars and monthly downloads.
nmcassa
letterboxdpy

A letterboxd webscraper

6K 163 29
EchterAlsFake
phub

A lightweight API for Pornhub

5K 143 37
AliAkhtari78
spotifyscraper

Spotify Scraper to extract all the information from spotify, download mp3 with cover of the song

4K 257 28
foreandr
hypersel

A Python-based web automation and data scraping framework

2K 1 0
tyleracorn
covid-alberta

looking at some of the alberta specific covid data

2K 1 0
sayedshaun
onecrawler

An async Python crawling framework for discovering URLs, extracting links, and scraping structured content.

2K 1 0
HelloThereMatey
tedata

Scraper for Trading Economics

1K 28 7
rootVIII
proxy-requests

Make HTTP requests with scraped proxies

1K 388 43
xtream1101
scraperx

Library for scraping websites or apis at any scale

1K 54 11
ishan-surana
metadatascraper

A module designed to automate the extraction of follower counts and post details from a public Facebook page.

903 13 1
GeminidSystems
googlenewsscraper

A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)

881 11 5
eugen1j
aioscrapy

Python asynchronous library for web scraping

850 10 3
vypivshiy
scrape-schema

A library for converting any text (xml, html, plain text, stdout, etc) to python datatypes

807 4 1
MichaelYochpaz
isubrip

A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.

740 210 23
JonathanVusich
pcpartpicker

A fast, simple API for PCPartPicker.com.

728 120 11
brandonrobertz
autoscrape

An automated, programming-free web scraper for interactive sites

658 111 20
HimashaHerath
llm-webextract

AI-powered web content extraction — turn any website into structured JSON using LLMs and LangChain

656 2 0
reppon97
soccer-data-api

An easy-to-use python web-scrap package that gets json soccer (football) data/stats.

603 8 0
toby-p
rightmove-webscraper

A class for scraping data from rightmove.co.uk

557 279 123
thicccat688
mintospy

Mintos web scraper (Updated for 2023)

535 9 4
imyourboyroy
web-scraper-toolkit

A powerful, standalone web scraping toolkit using Playwright and various parsers.

519 5 2
J-J-B-J
sentraltimetable

A simple Python function to summon your timetable from Sentral.

517 8 0
JaonHax
scpscraper

A Python library designed for scraping data from the SCP wiki.

495 16 4
zduclos
artvee-scraper

Scrape public domain artwork from https://www.artvee.com

474 11 2