Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.
Package Information
No reported malware or high/critical advisories · Details
The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.
Package Insights
- No releases in 636 days despite active commits
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100More insights and metrics
Downloads by OS
Python Versions
Top Countries
Weekly Downloads
GitHub Stars
Dependencies
- cmake >=3.21
- fastapi
- filelock >=3.10.4
- lm-format-enforcer ==0.10.1
- ninja
- npu-vllm ==0.4.2.post3
- numpy ==1.26.4
- openai
- outlines ==0.0.34
- prometheus-client >=0.18.0
- prometheus-fastapi-instrumentator >=7.0.0
- psutil
- py-cpuinfo
- pydantic >=2.0
- pynvml ==11.5.0
- ray ==2.9.3
- requests
- sentencepiece
- tiktoken ==0.6.0
- tokenizers >=0.19.1
- transformers >=4.40.0
- typing-extensions
- uvicorn
1 optional dependencies
-
tensorizer==2.9.0[tensorizer]extra == "tensorizer"