PyRank

Model Inference Service Python Packages

Python packages with the GitHub topic model-inference-service. Sorted by monthly downloads, with stars and forks.
bentoml
bentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

145K 9K 1K
bentoml
qwakbentoml

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

327 9K 1K
bentoml
bentoml-unsloth

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

300 9K 1K
bentoml
clip-api-service

CLIP as a service - Embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

227 67 4
bentoml
sentencebertservice

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

221 9K 1K
bentoml
bentoml-core

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

99 9K 1K
bentoml
yatai

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

89 9K 1K