PyRank

Spiders Python Packages

Python packages with the GitHub topic spiders. Sorted by relevance, with stars and monthly downloads.
scrapinghub
spidermon

Scrapy Extension for monitoring spiders execution.

23K 558 102
Tyrone-Zhao
crawlerutils

Crawler Utils examples

420 11 2
proxymesh
scrapy-proxy-headers

Add custom proxy headers to HTTPS requests in Scrapy

372 4 0
x1ah
cumtbscore

日常小脚本，懒人欢乐多。

367 103 26
victormartinez
shub-cli

A CLI at your hands to deal with the features of ScrapingHub.

164 16 0
harootune
scrapy-dynamic-spiders

Dynamically generate spider subclasses. Run crawls sequentially with crochet. Do both.

59 0 1