Scrapy Redis Python Packages

aio-scrapy

Implement scrapy with asyncio

aioscpy

An asyncio + aiolibs crawler imitate scrapy framework

scrapy-redis-sentinel

Redis Cluster for Scrapy.

scrapy-redis-bloomfilter-block-cluster

Scrapy Redis BloomFilter Block Cluster

scrapy-proxy-ip-pool

这是一个Scrapy中间件，用于管理代理IP池(支持使用Redis作为代理池)。