Scrape Python Packages

autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

218K 8K 831

twikit

111K 5K 573

twitter-api-client

Implementation of X/Twitter v1, v2, and GraphQL APIs

45K 2K 253

cfscrape

A Python module to bypass Cloudflare's anti-bot page.

25K 4K 444

scrapemm

LLM-friendly scraper for media and text from social media and the open web.

5K 6 0

proxyscrape

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

3K 266 54

tswift

MetroLyrics API for Python

3K 52 14

twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

2K 16K 3K

pyscrapers

project to produce various useful scrapers

882 34 7

autochromedriver

Downloads and unzips chromedriver to curent directory

852 4 0

cro-tax-debtors

Parse and search data from Croatian Tax Debtors website

821 0 0

nudecrawler

Crawl telegra.ph searching for nudes!

773 379 32

pyetfdb-scraper

Scrape ETF data for free - the unofficial python wrapper for ETFDB

601 70 8

mcp-crawl4ai

MCP (Model Context Protocol) server wrapping Crawl4AI library as functions using Python

393 0 2

freecrawl-mcp

A production-ready mcp server for web scraping and document processing. Drop-in replacement for FireCrawl.

342 4 0

scrapeer

A tiny Python library that lets you scrape HTTP(S) and UDP trackers for torrent information.

309 0 0

jimutmap

API to get enormous amount of high resolution satellite images from satellites.pro quickly through multi-threading! create map your own map dataset. Bringing data to Humans.

217 153 20

eksi-scraper

eksisozluk scraper. scrapes eksisozluk threads fast.

188 1 0

bitscrape

A modular, async Python web scraping framework — simple for a first spider, capable of distributed crawling, storage, search-ranking, and observability for everything after that.

187 1 0