Kserve Python Packages

kserve

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

kfserving

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

aissemble-open-inference-protocol-fastapi

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-shared

Shared Utilities for aiSSEMBLE Open Inference Protocol

aissemble-open-inference-protocol-grpc

Promote interoperability across diverse inference runtimes and platforms by adhering to the consistent OIP API specification for inference. Also provide a functionally driven client API to ease OIP invocation messiness.

aissemble-open-inference-protocol-kserve

A KServe implementation of the Open Inference Protocol

kserve-mathking

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes