Inference Api Python Packages

baseten-performance-client

The simplest way to serve AI/ML models in production

truss

The simplest way to serve AI/ML models in production

truss-transfer

The simplest way to serve AI/ML models in production

inference-sdk

Turn any computer or edge device into a command center for your computer vision projects.

inference

Turn any computer or edge device into a command center for your computer vision projects.

inference-gpu

Turn any computer or edge device into a command center for your computer vision projects.

inference-cli

Turn any computer or edge device into a command center for your computer vision projects.

inference-cpu

Turn any computer or edge device into a command center for your computer vision projects.

inference-core

Turn any computer or edge device into a command center for your computer vision projects.

qai-hub-models-cli

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

qai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

socaity

SDK for generative AI.

baseten-inference-client

The simplest way to serve AI/ML models in production

qai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

llm-magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

mozo

Run several computer vision models or a graph of them from one pip install, with the original's exact numbers.

modelgate-py

Containerized machine learning inference API and Python SDK. Instantly serve tabular ML models (Scikit-Learn/Joblib) dynamically from URLs with strict JSON schema validation and error shielding.

sunra-client

Python client for sunra.ai

semantic-ai

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

geniusrise-text

Text components powering LLMs & SLMs for geniusrise framework

smart-reid

Turn any computer or edge device into a command center for your computer vision projects.

textsum

CLI & Python API to easily summarize text-based files with transformers

aissemble-open-inference-protocol-fastapi

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-shared

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.