Vllm Serve Python Packages

vllm-cpu

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512vnni

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-amxbf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512bf16

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

vllm-cpu-avx512

Wheels & Docker images for running vLLM on CPU-only systems, optimized for different CPU instruction sets

agentsculptor

agentsculptor is an experimental AI-powered development agent designed to analyze, refactor, and extend Python projects automatically. It uses an OpenAI-like planner–executor loop on top of a vLLM backend, combining project context analysis, structured tool calls, and iterative refinement. It has only been tested with gpt-oss-120b via vLLM.

vllm-doctor

Diagnose vLLM inference servers

mvllm

Intelligent load balancer for distributed vLLM server clusters 分布式 vLLM 服务器集群的智能负载均衡器

sm-endpoint-bmt

A SageMaker endpoint benchmarking tool similar to vLLM bench serve.