The current version has a known security vulnerability. Review the advisory and consider upgrading.
scrapy has 6.2M monthly downloads and 63K GitHub stars. Version 2.17.0 supports Python 3.10+, first published in 2009.
It is actively maintained under a permissive license, last released in Jul 2026.
It is built on top of cryptography, cssselect and defusedxml. It is used by 407 tracked packages, including scrapy-playwright, scrapy-zyte-api and advertools.
GitHub topics include scraping, crawling and framework.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- cryptography >=37.0.0
- cssselect >=0.9.1
- defusedxml >=0.7.1
- itemadapter >=0.1.0
- itemloaders >=1.0.1
- lxml >=4.6.4
- packaging
- parsel >=1.5.0
- protego >=0.1.15
- pydispatcher >=2.0.5
- pyopenssl >=22.0.0
- pypydispatcher >=2.1.0
- queuelib >=1.4.2
- service-identity >=23.1.0
- tldextract
- twisted >=21.7.0
- w3lib >=1.17.0
- zope-interface >=5.1.0
Used By
- scrapy-playwright
- scrapy-zyte-api
- advertools
- scrapy-impersonate
- scrapy-splash
- scrapy-redis
- llama-index-readers-web
- scrapyd
- assetutilities
- scrapyd-client
- scrapy-selenium
- scrapinghub-entrypoint-scrapy
- scrapy-zyte-smartproxy
- news-please
- scrapy-poet
- shub-workflow
- scrapy-spider-metadata
- scrapy-stealth
- scrapy-inline-requests
- inspire-schemas
- aiecs
- meshagent-scrapy
- scrapy-calyprium
- city-scrapers-core
- e-models
- scrapy-curl-cffi
- scrapyscript
- scrapy-settings-log
- ayugespidertools
- duplicate-url-discarder
- zyte-spider-templates
- hepcrawl
- scrapy-deltafetch
- scrapy-useragents
- fzutils
- scrapy-zen
- plexflow
- scrapy-frontera
- phantomsignal
- scrapy-cloudflare-middleware
- canvasrobot
- scrapy-zenrows
- clappscrapers
- webcomix
- scrapy-querycleaner
- scrapy-dotpersistence
- scrapy-magicfields
- scrapy-splitvariants
- comicguispider
- askpablos-scrapy-api