Inference Api Python Packages

inference-gpu

Turn any computer or edge device into a command center for your computer vision projects.

inference-cli

Turn any computer or edge device into a command center for your computer vision projects.

truss

The simplest way to serve AI/ML models in production

truss-transfer

The simplest way to serve AI/ML models in production

baseten-performance-client

The simplest way to serve AI/ML models in production

inference-sdk

Turn any computer or edge device into a command center for your computer vision projects.

inference

Turn any computer or edge device into a command center for your computer vision projects.

qai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

qai-hub-models-cli

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

inference-core

Turn any computer or edge device into a command center for your computer vision projects.

inference-cpu

Turn any computer or edge device into a command center for your computer vision projects.

baseten-inference-client

The simplest way to serve AI/ML models in production

llm-magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

socaity

Your SDK and model zoo for generative AI. Build AI-powered applications with ease.

yolomosaic

A Python library for visualizing YOLO detections and segmented instances on large orthomosaic images, with the ability to generate shapefiles for GIS integration

sunra-client

Python client for sunra.ai

geniusrise-text

Text components powering LLMs & SLMs for geniusrise framework

qai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

minrlm

A small Recursive Language Model: let any LLM run code on its context instead of stuffing it into the prompt.

semantic-ai

Sematic AI RAG System

textsum

CLI & Python API to easily summarize text-based files with transformers

aissemble-open-inference-protocol-shared

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-kserve

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-grpc

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.