PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Scrapy Extension Python Packages

Python packages with the GitHub topic scrapy-extension. Sorted by relevance, with stars and monthly downloads.
shengchenyang
ayugespidertools

使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。

7K 100 16
sangaline
scrapy-wayback-machine

A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

460 122 32
stummjr
scrapy-fieldstats

A Scrapy extension to generate a summary of fields coverage from your scraped data.

402 19 4
abebus
spider-info-webservice

Scrapy extension for monitoring spider.

150 1 0
crawlaio
scrapy-spiderstats-extension

Scrapy Spider Stats to MongoDB Extension

109 1 0
rudeigerc
scrapy-slackbot

A Scrapy extension to send notification to the Slack channel.

99 9 3
sp1thas
scrapy-folder-tree

A scrapy pipeline which stores files using folder trees.

67 9 3
    • Data from PyPI, GitHub, ClickHouse, and BigQuery