PyRank

Kvcache Python Packages

Python packages with the GitHub topic kvcache. Sorted by relevance, with stars and monthly downloads.
kvcache-ai
mooncake-transfer-engine

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

176K 6K 926
kvcache-ai
mooncake-transfer-engine-cuda13

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

79K 6K 926
kvcache-ai
tokenspeed-mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

12K 6K 926
ModelEngine-Group
uc-manager

Persist and reuse KV Cache to speedup your LLM.

9K 295 88
kvcache-ai
mooncake-transfer-engine-non-cuda

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

4K 6K 926
kvcache-ai
mooncake-transfer-engine-npu

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

1K 6K 926
ovg-project
kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

1K 1K 122
uccl-project
uccl

UCCL: Ultra and Unified CCL

1K 1K 159