PyRank

Deepseek V3 Python Packages

Python packages with the GitHub topic deepseek-v3. Sorted by monthly downloads, with stars and forks.
vllm-project
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

2.1M 94K 23K
vllm-project
vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

23K 94K 23K
vllm-project
vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

16K 94K 23K
InternLM
xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

1K 5K 455
vllm-project
vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

418 94K 23K
vllm-project
ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

411 94K 23K
vllm-project
vllm-dgxspark-psychoscales

A high-throughput and memory-efficient inference and serving engine for LLMs

357 94K 23K
vllm-project
vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

235 94K 23K
vllm-project
vllm-musa

A high-throughput and memory-efficient inference and serving engine for LLMs

220 94K 23K
vllm-project
vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs

212 94K 23K
vllm-project
vllm-usf

A high-throughput and memory-efficient inference and serving engine for LLMs

210 94K 23K
vllm-project
vllm-test-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

209 94K 23K
vllm-project
hive-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

209 94K 23K
vllm-project
vllm-fixed

A high-throughput and memory-efficient inference and serving engine for LLMs

178 94K 23K
vllm-project
vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

172 94K 23K
vllm-project
vllm-online

A high-throughput and memory-efficient inference and serving engine for LLMs

172 94K 23K
vllm-project
nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

143 94K 23K
vllm-project
vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

86 94K 23K
vllm-project
vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

81 94K 23K
vllm-project
wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

57 94K 23K
vllm-project
tilearn-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

56 94K 23K
vllm-project
vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs

40 94K 23K
vllm-project
tilearn-test01

A high-throughput and memory-efficient inference and serving engine for LLMs

28 94K 23K