PyRank

Inference Platform Python Packages

Python packages with the GitHub topic inference-platform. Sorted by monthly downloads, with stars and forks.
bentoml
bentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

145K 9K 1K
bentoml
qwakbentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

327 9K 1K
bentoml
bentoml-unsloth

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

300 9K 1K
bentoml
sentencebertservice

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

221 9K 1K
bentoml
bentoml-core

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

99 9K 1K
bentoml
yatai

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

89 9K 1K