Bentoml Python Packages

whispercpp

Pybind11 bindings for Whisper.cpp

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

llmchatbot

Chatbot with LLM

bentoml-plugins-arize

the swish knife to all things bentoml.

tkitbentomlframeworksexpand

借助Bentoml可以快速的实现模型的部署，这里写了几个Frameworks，用来实现快速的模型部署。