PyRank

Scrape Python Packages

Python packages with the GitHub topic scrape. Sorted by relevance, with stars and monthly downloads.
d60
twikit

Twitter API Scraper | Without an API key | Twitter Internal API | Free | Twitter scraper | Twitter Bot

174K 5K 553
Anorov
cfscrape

A Python module to bypass Cloudflare's anti-bot page.

48K 4K 450
trevorhobenshield
twitter-api-client

Implementation of X/Twitter v1, v2, and GraphQL APIs

23K 2K 253
jaredlgillespie
proxyscrape

Python library for retrieving free proxies (HTTP, HTTPS, SOCKS4, SOCKS5).

8K 262 55
brenns10
tswift

MetroLyrics API for Python

5K 51 14
AWeirdDev
air-web

A lightweight package for crawling the web with the minimalist of code.

4K 0 0
twintproject
twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

3K 16K 3K
alirezamika
autoscraper

A Smart, Automatic, Fast and Lightweight Web Scraper for Python

2K 7K 766
tboy1337
scrapeer

A tiny Python library that lets you scrape HTTP(S) and UDP trackers for torrent information.

2K 0 0
joeyism
autochromedriver

Downloads and unzips chromedriver to curent directory

1K 4 0
yaroslaff
nudecrawler

Crawl telegra.ph searching for nudes!

1K 372 30
multimodal-ai-lab
scrapemm

LLM-friendly scraper for media and text from social media and the open web.

978 6 0
arrrlo
cro-tax-debtors

Parse and search data from Croatian Tax Debtors website

898 0 0
lvxhnat
pyetfdb-scraper

Scrape ETF data for free - the unofficial python wrapper for ETFDB

686 70 8
veltzer
pyscrapers

project to produce various useful scrapers

653 33 7
wyattowalsh
mcp-crawl4ai

MCP (Model Context Protocol) server wrapping Crawl4AI library as functions using Python

461 0 2
Jimut123
jimutmap

To get enormous amount of map tiles with ease

417 150 20
iberkayC
eksi-scraper

eksisozluk scraper. scrapes eksisozluk threads fast.

370 1 0
dawsonbooth
emoji-search

The #1 Python tool for miscellaneous emoji info

369 2 0
rishi-raj-jain
twitterusernameviauserid

twitterUsernameviaUserID is an advanced Twitter scraping tool written in Python and Selenium that allows for scraping tweet usernames from the twitter id's, without using Twitter's API.

340 16 4
saadmanrafat
imgur-scraper

Retrieve years of imgur.com's data without any authentication.

337 37 7
medecau
scrapedict

Scrape HTML to dictionaries

314 2 0
Social-Media-Public-Analysis
dozent

Dozent is a powerful downloader that is used to download a ton of twitter data from the internet archive.

301 7 0
dylan-gluck
freecrawl-mcp

A production-ready mcp server for web scraping and document processing. Drop-in replacement for FireCrawl.

279 3 0