vllm has 5.8M monthly downloads and 86K GitHub stars. Version 0.24.0 supports Python <3.15,>=3.10, first published in 2023.
It is actively maintained under a permissive license, last released in Jun 2026.
It is built on top of aiohttp, anthropic and apache-tvm-ffi. It is used by 187 tracked packages, including rank-llm, vllm-rbln and cjm-transcription-plugin-voxtral-vllm.
GitHub topics include gpt, llm and pytorch.
Package Insights
((week_daily_avg - month_daily_avg) / month_daily_avg) * 100Weekly Downloads
GitHub Stars
Downloads by OS
Python Versions
Top Countries
Dependencies
- aiohttp >=3.13.3
- anthropic >=0.71.0
- apache-tvm-ffi ==0.1.9
- blake3
- cachetools
- cbor2
- cloudpickle
- compressed-tensors ==0.17.0
- depyf ==0.20.0
- diskcache ==5.6.3
- einops
- fastapi <0.137.0,>=0.133.0
- fastsafetensors >=0.3.2
- filelock >=3.16.1
- flashinfer-cubin ==0.6.12
- flashinfer-python ==0.6.12
- humming-kernels ==0.1.6
- ijson
- jsonschema >=4.23.0
- lark ==1.2.2
- llguidance <1.8.0,>=1.7.0
- lm-format-enforcer ==0.11.3
- mcp
- mistral-common >=1.11.3
- model-hosting-container-standards <1.0.0,>=0.1.14
- msgspec
- ninja
- numba ==0.65.0
- numpy
- nvidia-cudnn-frontend >=1.19.1
- nvidia-cutlass-dsl ==4.5.2
- openai >=2.0.0
- openai-harmony >=0.0.3
- opencv-python-headless >=4.13.0
- opentelemetry-api >=1.27.0
- opentelemetry-exporter-otlp >=1.27.0
- opentelemetry-sdk >=1.27.0
- opentelemetry-semantic-conventions-ai >=0.4.1
- outlines-core ==0.2.14
- partial-json-parser
- pillow
- prometheus-client >=0.18.0
- prometheus-fastapi-instrumentator >=8.0.0
- protobuf !=6.30.*,!=6.31.*,!=6.32.*,!=6.33.0.*,!=6.33.1.*,!=6.33.2.*,!=6.33.3.*,!=6.33.4.*,>=5.29.6
- psutil
- py-cpuinfo
- pybase64
- pydantic >=2.12.0
- python-json-logger
- pyyaml
- pyzmq >=25.0.0
- quack-kernels >=0.3.3
- regex
- requests >=2.26.0
- safetensors >=0.6.2
- sentencepiece
- setproctitle
- setuptools <81.0.0,>=77.0.3
- six >=1.16.0
- starlette >=1.0.1
- tiktoken >=0.6.0
- tilelang ==0.1.9
- tokenizers >=0.21.1
- tokenspeed-mla ==0.1.2
- torch ==2.11.0
- torchaudio ==2.11.0
- torchvision ==0.26.0
- tqdm
- transformers >=5.5.3
- typing-extensions >=4.10
- watchfiles
- xgrammar <1.0.0,>=0.2.1
23 optional dependencies
- av[audio]
- datasets[bench]
- fastsafetensors[fastsafetensors]
- helion[helion]
- instanttensor[instanttensor]
- matplotlib[bench]
- mistral-common[audio]
- opentelemetry-api[otel]
- opentelemetry-exporter-otlp[otel]
- opentelemetry-sdk[otel]
- opentelemetry-semantic-conventions-ai[otel]
- pandas[bench]
- plotly[bench]
- runai-model-streamer[runai]
- scipy[audio]
- scipy[bench]
- seaborn[bench]
- smg-grpc-servicer[grpc]
- soundfile[audio]
- soxr[audio]
- tensorizer[tensorizer]
- vllm-gguf-plugin[extra-quant]
- zentorch[zen]
Used By
- rank-llm
- vllm-rbln
- cjm-transcription-plugin-voxtral-vllm
- vllm-gguf-plugin
- text2text
- qwerky-vllm-models
- hipporag
- bigcodebench
- sendnn-inference
- factory-sdk
- vllm-spyre
- arbor-ai
- llm-optimized-inference
- kani-ext-vllm
- turboquant-vllm
- orpheus-speech
- llama-index-embeddings-vllm
- londonaicentre-mesa-local
- embedl-models
- cirilla
- vllm-tgis-adapter
- finance-data-llm
- meralion-3-asr
- fasr-asr-qwen3asr
- fasr-asr-qwen3
- llm-engines
- dataflow-421
- happy-vllm
- topicgpt-python
- geoai-vlm
- twinweaver
- text2dataset
- vllm-speculative-autoconfig
- patientsim
- retrieval-heads
- oat-llm
- roboreason
- auralis
- geniusrise-text
- llmlite
- h-adminsim
- sinapsis-vllm
- protollm-api
- async-chat-engine
- himile-model-middleware
- vllm-mock
- finetune-embedder
- papertuner
- easyroutine
- llmq