Vllm Serve Python Packages

vllm-cpu

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512vnni

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-amxbf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512bf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-doctor

Diagnostic tool for vLLM inference servers

agentsculptor

agentsculptor is an experimental AI-powered development agent designed to analyze, refactor, and extend Python projects automatically. It uses an OpenAI-like planner–executor loop on top of a vLLM backend, combining project context analysis, structured tool calls, and iterative refinement. It has only been tested with gpt-oss-120b via vLLM.

mvllm

Intelligent load balancer for distributed vLLM server clusters 分布式 vLLM 服务器集群的智能负载均衡器