PyRank

Deepseek V3 Python Packages

Python packages with the GitHub topic deepseek-v3. Sorted by relevance, with stars and monthly downloads.
vllm-project
vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

6.2M 81K 17K
vllm-project
vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

170K 81K 17K
InternLM
xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

2K 5K 422
vllm-project
ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

620 81K 17K
vllm-project
vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

536 81K 17K
vllm-project
vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

510 81K 17K
vllm-project
wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs

407 2K 1K
vllm-project
nextai-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

406 81K 17K
vllm-project
vllm-consul

A high-throughput and memory-efficient inference and serving engine for LLMs

384 81K 17K
vllm-project
vllm-musa

A high-throughput and memory-efficient inference and serving engine for LLMs

364 81K 17K
vllm-project
vllm-npu

A high-throughput and memory-efficient inference and serving engine for LLMs

354 81K 17K
vllm-project
vllm-hust

A high-throughput and memory-efficient inference and serving engine for LLMs

296 81K 17K
vllm-project
vllm-emissary

A high-throughput and memory-efficient inference and serving engine for LLMs

258 81K 17K
vllm-project
vllm-online

A high-throughput and memory-efficient inference and serving engine for LLMs

234 81K 17K
vllm-project
vllm-usf

A high-throughput and memory-efficient inference and serving engine for LLMs

233 81K 17K
vllm-project
vllm-rocm

A high-throughput and memory-efficient inference and serving engine for LLMs

217 81K 17K
vllm-project
vllm-test-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

170 81K 17K
vllm-project
tilearn-infer

A high-throughput and memory-efficient inference and serving engine for LLMs

119 81K 17K
vllm-project
hive-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

106 81K 17K
vllm-project
vllm-fixed

A high-throughput and memory-efficient inference and serving engine for LLMs

87 81K 17K
vllm-project
tilearn-test01

A high-throughput and memory-efficient inference and serving engine for LLMs

67 81K 17K