Scrapy Redis Python Packages

aio-scrapy

A high-level Web Crawling and Web Scraping framework based on Asyncio

aioscpy

An asyncio + aiolibs crawler imitate scrapy framework

scrapy-redis-bloomfilter-block-cluster

Scrapy Redis with Bloom Filter，support redis sentinel and cluster

scrapy-redis-sentinel

Redis Cluster for Scrapy.

scrapy-proxy-ip-pool

这是一个Scrapy中间件，用于管理代理IP池(支持使用Redis作为代理池)。