PyRank

Disaggregated Serving Python Packages

Python packages with the GitHub topic disaggregated-serving. Sorted by relevance, with stars and monthly downloads.
ai-dynamo
ai-dynamo-runtime

A Datacenter Scale Distributed Inference Serving Framework

50K 7K 1K
ai-dynamo
ai-dynamo

A Datacenter Scale Distributed Inference Serving Framework

38K 7K 1K
DeepLink-org
dlslime

Composable and Embeddable Communication Runtime for Distributed AI Services

7K 102 9
DeepLink-org
dlslime-ctrl

Composable and Embeddable Communication Runtime for Distributed AI Services

2K 102 9
ai-dynamo
kvbm

A Datacenter Scale Distributed Inference Serving Framework

1K 7K 1K