Inference Api Python Packages

truss

The simplest way to serve AI/ML models in production

inference-gpu

Turn any computer or edge device into a command center for your computer vision projects.

inference-cli

Turn any computer or edge device into a command center for your computer vision projects.

baseten-performance-client

The simplest way to serve AI/ML models in production

truss-transfer

The simplest way to serve AI/ML models in production

inference-sdk

Turn any computer or edge device into a command center for your computer vision projects.

inference

Turn any computer or edge device into a command center for your computer vision projects.

qai-hub-models

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

qai-hub-models-cli

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

inference-cpu

Turn any computer or edge device into a command center for your computer vision projects.

inference-core

Turn any computer or edge device into a command center for your computer vision projects.

baseten-inference-client

The simplest way to serve AI/ML models in production

socaity

SDK for generative AI.

llm-magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

textsum

CLI & Python API to easily summarize text-based files with transformers

qai-hub-apps

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

geniusrise-text

Text components powering LLMs & SLMs for geniusrise framework

yolomosaic

A Python library for visualizing YOLO detections and segmented instances on large orthomosaic images, with the ability to generate shapefiles for GIS integration

semantic-ai

An open source framework for Retrieval-Augmented System (RAG) uses semantic search helps to retrieve the expected results and generate human readable conversational response with the help of LLM (Large Language Model).

sunra-client

Python client for sunra.ai

aissemble-open-inference-protocol-fastapi

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-shared

Shared Utilities for aiSSEMBLE Open Inference Protocol

aissemble-open-inference-protocol-grpc

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-kserve

A KServe implementation of the Open Inference Protocol