PyRank
  • Insights
  • PyPI
  • GitHub
  • Search
  • Compare
  • Advisories
  • Ecosystem
  • About

Model Inference Python Packages

Python packages with the GitHub topic model-inference. Sorted by relevance, with stars and monthly downloads.
bentoml
openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

11K 12K 811
bentoml
openllm-core

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

4K 12K 811
bentoml
openllm-client

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

2K 12K 811
bentoml
clip-api-service

Build AI applications with any CLIP models - embed image and sentences, object recognition, visual reasoning, image classification and reverse image search

1K 66 4
hscspring
lightinfer

A lightweight bridge to serve synchronous model inference via async FastAPI.

80 0 0
    • Data from PyPI, GitHub, ClickHouse, and BigQuery