Downloads in the 30 and 7 days to October 10, 2026. Refreshed weekly.
Package Information
No reported malware or high/critical advisories · Details
The current version has no OSV.dev malware reports and no critical or high-severity vulnerabilities.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100More insights and metrics
Downloads by OS
Python Versions
Top Countries
Weekly Downloads
GitHub Stars *
Dependencies
- apache-tvm-ffi >=0.1.11
- numpy
- pydantic
- torch >=1.10.0
- transformers >=4.38.0
-
triton
platform_system == "Linux" and platform_machine == "x86_64"
- typing-extensions >=4.9.0
7 optional dependencies
-
cohere-melody==0.13.0[test]python_version >= "3.10" and extra == "test"
-
huggingface-hub[test]extra == "test"
-
mlx-lm[metal]platform_system == "Darwin" and platform_machine == "arm64" and extra == "metal"
-
protobuf[test]extra == "test"
-
pytest[test]extra == "test"
-
sentencepiece<0.2.2[test]python_version < "3.10" and extra == "test"
-
tiktoken[test]extra == "test"
Used By
- sglang 2.5M/mo
- vllm 2.1M/mo
- lmdeploy 30.1K/mo
- vllm-cpu-nightly 22.6K/mo
- tensorrt-llm 18.7K/mo
- vllm-tpu 15.7K/mo
- vllm-cpu 13.3K/mo
- vllm-ascend 5.2K/mo
- mostlyai-engine 3.3K/mo
- aphrodite-engine 2.6K/mo