PyRank

Disaggregated Serving Python Packages

Python packages with the GitHub topic disaggregated-serving. Sorted by monthly downloads, with stars and forks.
ai-dynamo
ai-dynamo-runtime

A Datacenter Scale Distributed Inference Serving Framework

69K 8K 2K
ai-dynamo
ai-dynamo

A Datacenter Scale Distributed Inference Serving Framework

47K 8K 2K
ai-dynamo
kvbm

A Datacenter Scale Distributed Inference Serving Framework

11K 8K 2K
athrael-soju
narwhal-inference

Adaptive Disaggregated Inference on a Role-free Fleet!

3K 8 2