crawl4ai has 2.1M monthly downloads and 71K GitHub stars. Version 0.9.0 supports Python 3.10+, first published in 2024.
It is actively maintained under a permissive license, last released in Jun 2026.
It is built on top of aiofiles, aiohttp and aiosqlite. It is used by 133 tracked packages, including unique-web-search, mnemoai-assistant and local-deep-research.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- aiofiles >=24.1.0
- aiohttp >=3.11.11
- aiosqlite ~=0.20
- alphashape >=1.3.1
- anyio >=4.0.0
- beautifulsoup4 ~=4.12
- brotli >=1.1.0
- chardet >=5.2.0
- click >=8.1.7
- cssselect >=1.2.0
- fake-useragent >=2.0.3
- httpx >=0.27.2
- humanize >=4.10.0
- lark >=1.2.2
- lxml ~=5.3
- nltk >=3.9.1
- numpy <3,>=1.26.0
- patchright >=1.49.0
- pillow >=10.4
- playwright >=1.49.0
- playwright-stealth >=2.0.0
- psutil >=6.1.1
- pydantic >=2.10
- pyopenssl >=25.3.0
- python-dotenv ~=1.0
- pyyaml >=6.0
- rank-bm25 ~=0.2
- requests ~=2.26
- rich >=13.9.4
- shapely >=2.0.0
- snowballstemmer ~=2.2
- unclecode-litellm ==1.81.13
- xxhash ~=3.4
20 optional dependencies
- nltk[torch]
- nltk[cosine]
- nltk[all]
- pypdf[all]
- pypdf[pdf]
- scikit-learn[all]
- scikit-learn[torch]
- selenium[all]
- selenium[sync]
- sentence-transformers[transformer]
- sentence-transformers[cosine]
- sentence-transformers[all]
- tokenizers[transformer]
- tokenizers[all]
- torch[torch]
- torch[all]
- torch[cosine]
- transformers[transformer]
- transformers[cosine]
- transformers[all]
Used By
- unique-web-search
- mnemoai-assistant
- local-deep-research
- n24q02m-web-core
- synapse-orch-ai
- undefined-bot
- regcode
- fagoon-upgrade
- liferay-docs-scraper
- nlr-elm
- nrel-elm
- crawl-mcp
- infra-compass
- wyn360-cli
- superagentx-handlers
- crm-automator
- wizsearch
- torrent-search-mcp
- citeindex
- hyperresearch
- agent-memory-labs
- crawl4ai-skill
- infiagent
- vibex
- clawdeck
- llm-min
- bad-research
- dataimpulse-scraper
- local-web-search
- browsemind
- morph-websearch-mcp
- crawl4ai-mcp-sse-stdio
- crawl4agent
- crawl4ai-mcp-server
- wistx-mcp
- crawl4ai-mcp
- campaign-generator
- taskcraft
- openfox
- docscrape
- url2llm
- md-server
- llmify-cli
- rag-retriever
- mark
- open-deepsearch
- pickle-bot
- mashell
- celo-mcp
- data-generation-agents