PyRank

Vllm Server Python Packages

Python packages with the GitHub topic vllm-server. Sorted by relevance, with stars and monthly downloads.
MekayelAnik
vllm-cpu

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

30K 6 0
MekayelAnik
vllm-cpu-avx512vnni

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

2K 6 0
MekayelAnik
vllm-cpu-avx512bf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

2K 6 0
MekayelAnik
vllm-cpu-amxbf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

2K 6 0
MekayelAnik
vllm-cpu-avx512

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

2K 6 0