PyRank

Trt Llm Python Packages

Python packages with the GitHub topic trt-llm. Sorted by monthly downloads, with stars and forks.
kvcache-ai
mooncake-transfer-engine-cuda13

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

222K 7K 1K
kvcache-ai
mooncake-transfer-engine

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

75K 7K 1K
kvcache-ai
mooncake-transfer-engine-non-cuda

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

15K 7K 1K
kvcache-ai
tokenspeed-mooncake

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

7K 7K 1K
kvcache-ai
mooncake-transfer-engine-rocm

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

6K 7K 1K
kvcache-ai
mooncake-transfer-engine-efa-cuda13

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

4K 7K 1K
kvcache-ai
mooncake-transfer-engine-npu

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

2K 7K 1K
kvcache-ai
mooncake-transfer-engine-efa

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

414 7K 1K
kvcache-ai
mooncake-transfer-engine-efa-non-cuda

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

408 7K 1K
kvcache-ai
mooncake-transfer-engine-musa

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

160 7K 1K