PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Scrapper Python Packages

Python packages with the GitHub topic scrapper. Sorted by monthly downloads, with stars and forks.
kacigaya
webskrap

Python scraping framework built on Playwright.

6K 1 0
ClementJ18
moddb

A Python scrapper to access ModDB mods, games and more as objects

2K 18 9
mlesniew
elicznik

Tauron eLicznik Python module

549 16 10
KnightChaser
mitreattackscrapper

A simple scrapper for MITRE ATT&CK information written in Python3.

468 3 0
bajatin
ctft

Command line CTFtime writeup scrapper and stylised viewing tool.

409 4 0
Xonshiz
comic-dl

Comic-dl is a command line tool to download manga and comics from various comic and manga sites. Supported sites : readcomiconline.to, mangafox.me, comic naver and many more.

371 680 74
555Russich
proxy-master

Python module to scrap FREE proxies from websites

278 1 1
Sreejoy
crawlerfriend

A light weight crawler which gives search results in HTML form or in Dictionary form, given URLs and keywords.

278 1 0
DreamCobbler
fiction-dl

A content downloader, capable of retrieving works of (fan)fiction from the web and saving them in a few common file formats.

278 54 6
Hiericho
architect-net

Low-level network engine for browser fingerprint emulation. Bypasses WAFs via uTLS, ECH, and HTTP/2 frame manipulation.

242 1 0
iw4p
proxyz

scrape proxies from more than 5 different sources and check which ones are still alive

222 600 137
Gabriellgpc
pexel-downloader

"Pexel Downloader: Python-based web scraper for effortlessly downloading high-quality photos and videos from Pexels.com, open-source with MIT License."

197 22 4
5hirish
tweetscrape

Scrape the Twitter frontend API without any authentication and restriction.

195 61 11
Sudharsansm
bitscrape

A modular, async Python web scraping framework — simple for a first spider, capable of distributed crawling, storage, search-ranking, and observability for everything after that.

187 1 0
edwardseley
lyricscorpora

An unofficial Python API that allows users to create a corpus of lyrical text from their favorite artists and billboard charts

119 18 1
DiptoDas8
quoras

A Python package to collect data from Quora.

109 3 2
Adeyemi0
zillow-scraper

This library scrapes zillow property website

108 0 0
rdnve
finavis

another unofficial api for some financial visualization website

95 1 0
limebrains
scrapper-helpers

Scrapper helpers, utils

77 1 5
ZKAW
wclone

Basic website cloner

77 60 12
kieled
aytch

AYTCH - Async YouTube Channel Scrapper without API keys and limits.

61 2 1
limebrains
pyolx

Python scrapper for olx

54 11 8
arutselvan
imgscrapy

A simple and fast CLI for multithreaded image scraping with support for headless scraping of dynamic websites.

50 3 0
luiseduardobr1
pyolxbrazil

Scrapper for OLX Brazil

48 6 3
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology