Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.
Package Information
No reported malware or high/critical advisories · Details
The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100More insights and metrics
Downloads by OS
Python Versions
Top Countries
Weekly Downloads
GitHub Stars
Dependencies
- accelerate >=1.13.0
- datasets >=3.6.0
- defuser >=0.0.28
- device-smi >=0.5.7
- dill >=0.3.8
- filelock
- jinja2 >=3.1.0
- logbar >=0.4.14
- maturin >=1.9.4
- ninja >=1.13.0
-
numpy
==2.2.6
python_version < "3.14"
- packaging >=24.2
- pillow >=11.3.0
- protobuf >=7.34.0
- pyarrow >=21.0
- pypcre >=0.6.2
- safetensors >=0.7.0
- threadpoolctl >=3.6.0
- tokenicer >=0.0.14
- torch >=2.8.0
- torchao >=0.16.0
- transformers >=5.14.0
25 optional dependencies
-
bitblas==0.1.0.post1[bitblas]extra == "bitblas"
-
bitsandbytes>=0.49.3[bitsandbytes]extra == "bitsandbytes"
-
evalution>=0.0.17[eval]extra == "eval"
-
fastapi[openai]extra == "openai"
-
flashinfer-python>=0.3.1[vllm]extra == "vllm"
-
flashinfer-python>=0.3.1[sglang]extra == "sglang"
-
mlx-lm>=0.24.0[mlx]extra == "mlx"
-
nvidia-cublas>=13.1.0.3[marlin-cuda]extra == "marlin-cuda"
-
nvidia-cublas-cu12==12.9.1.4[marlin-cuda12]extra == "marlin-cuda12"
-
nvidia-cuda-runtime>=13.0.96[marlin-cuda]extra == "marlin-cuda"
-
nvidia-cuda-runtime-cu12==12.9.79[marlin-cuda12]extra == "marlin-cuda12"
-
nvidia-cusolver>=12.0.4.66[marlin-cuda]extra == "marlin-cuda"
-
nvidia-cusolver-cu12==11.7.5.82[marlin-cuda12]extra == "marlin-cuda12"
-
nvidia-cusparse>=12.6.3.3[marlin-cuda]extra == "marlin-cuda"
-
nvidia-cusparse-cu12==12.5.10.65[marlin-cuda12]extra == "marlin-cuda12"
-
optimum>=1.21.2[hf]extra == "hf"
-
parameterized[test]extra == "test"
-
pydantic[openai]extra == "openai"
-
pytest>=8.3.5[test]extra == "test"
-
pytest-timeout>=2.3.1[test]extra == "test"
-
ruff==0.14.2[quality]extra == "quality"
-
sglang>=0.4.6[sglang]extra == "sglang"
-
triton>=3.4.0[triton]extra == "triton"
-
uvicorn[openai]extra == "openai"
-
vllm>=0.10.2[vllm]extra == "vllm"
Used By
- ai-companion-llm-backend 592/mo
- hdi1 122/mo