Webscraper Python Packages

clear-outside-apy

Webscraper/API for ClearOutside.com

letterboxdpy

A letterboxd webscraper

aniworld

AniWorld Downloader is a free, open-source app for finding and downloading anime, movies, series, and manga, with video streaming support. Available on Windows, macOS, and Linux, with a Web UI, terminal menu, CLI, and Docker support. If you enjoy using it, feel free to leave a ⭐!

phub

Unofficial Python client for xvideos.com: search, metadata extraction, and video download (curl-cffi + selectolax)

hypersel

HyperSel is a Python-based framework for web automation and data scraping. It simplifies crawling, automating interactions, and data extraction from web pages. It is built with various robust tools to handle dynamic and complex web interactions efficiently, offering features such as headless browsing, proxy support, and API sniffing.

isubrip

A Python command-line tool for scraping and downloading subtitles from AppleTV and iTunes movie pages.

unofficial-api-for-pornhub

Unofficial Python client for xvideos.com: search, metadata extraction, and video download (curl-cffi + selectolax)

proxy-requests

a class that uses scraped proxies to make http GET/POST requests (Python requests)

scraperx

Library for scraping websites or apis at any scale

tedata

Scraper for Trading Economics

scrape-schema

Structuring parsed data into python objects

googlenewsscraper

A Python package that scrapes Google News article data while remaining undetected by Google. Our scraper can scrape page data up until the last page and never trigger a CAPTCHA (download stats: https://pepy.tech/project/GoogleNewsScraper)

pcpartpicker

This is an unofficial API for the website pcpartpicker.com.

strava-cz

High level API pro interakci s webovou aplikaci Strava.cz udelane v Pythonu

metadatascraper

MetaDataScraper is a Python package designed to automate the extraction of follower counts and post details from a public Facebook page. It uses Selenium WebDriver for web automation and scraping. Official documentation at https://metadatascraper.readthedocs.io

aioscrapy

Python asynchronous library for web scrapping

llm-webextract

AI-powered web content extraction — turn any website into structured JSON using LLMs and LangChain

scpscraper

A Python library designed for scraping data from the SCP wiki.

web-scraper-toolkit

AI-first web scraping engine with stealth bypass, MCP server, and multimodal output (Markdown, JSON, PDF) for agents and automation.

mintospy

Mintos web scraper (Updated for 2023)

pytwitterscraper

Twitter Scraper With Python

imgur-downloader

Python script/class to download an entire Imgur album in one go into a folder of your choice.

soccer-data-api

An easy-to-use python web-scrap package that gets json soccer (football) data/stats.

onecrawler

Async Python crawling library with sitemap discovery, browser-based extraction, and LLM-powered structured output — one Settings object drives it all.