Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.
Package Information
No reported malware or high/critical advisories · Details
The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100More insights and metrics
Downloads by OS
Python Versions
Top Countries
Weekly Downloads
GitHub Stars
Dependencies
- accelerate
- asyncio
- deepspeed >=0.15.0
- deepspeed-kernels
- fastapi
- fastchat
- flask-restful
- grpcio
- grpcio-tools
- pillow
- pydantic >=2.0.0
- pyzmq
- safetensors
- shortuuid
- torch
- transformers
- ujson
- werkzeug
8 optional dependencies
-
clang-format==18.1.3[dev]extra == "dev"
-
einops[dev]extra == "dev"
-
pre-commit>=2.20.0[dev]extra == "dev"
-
pytest[dev]extra == "dev"
-
pytest-forked[dev]extra == "dev"
-
sentencepiece[dev]extra == "dev"
-
tiktoken[dev]extra == "dev"
-
transformers-stream-generator[dev]extra == "dev"
Used By
- llm-optimized-inference 776/mo
- fm-optimized-inference 34/mo