PyRank

Deepseek V3 Python Packages

Python packages with the GitHub topic deepseek-v3. Sorted by relevance, with stars and monthly downloads.
vllm-project
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

5.8M 85K 19K
vllm-project
vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

58K 85K 19K
vllm-project
vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

16K 85K 19K
InternLM
xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

2K 5K 427
vllm-project
ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

606 85K 19K
vllm-project
vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

575 85K 19K
vllm-project
vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

506 85K 19K
vllm-project
vllm-musa

vLLM platform plugin for Moore Threads MUSA GPUs

426 85K 19K
vllm-project
vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

407 85K 19K
vllm-project
vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

401 85K 19K
vllm-project
nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

399 85K 19K
vllm-project
vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

312 85K 19K
vllm-project
vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs

280 85K 19K
vllm-project
vllm-usf

vLLM-USF: A high-throughput and memory-efficient inference engine for LLMs (USF Custom Build)

252 85K 19K
vllm-project
vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs with AMD GPU support

198 85K 19K
vllm-project
vllm-online

A high-throughput and memory-efficient inference and serving engine for LLMs

195 85K 19K
vllm-project
vllm-test-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

194 85K 19K
vllm-project
tilearn-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

142 85K 19K
vllm-project
wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

139 85K 19K
vllm-project
vllm-fixed

A high-throughput and memory-efficient inference and serving engine for LLMs

122 85K 19K
vllm-project
hive-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

122 85K 19K
vllm-project
tilearn-test01

A high-throughput and memory-efficient inference and serving engine for LLMs

84 85K 19K
vllm-project
tmp-test-vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

18 85K 19K