Model Deployment Python Packages

synapseml

Simple and Distributed Machine Learning Python Library porting ML algorithms for Spark

openlayer

The official Python library for Openlayer, the Continuous Model Improvement Platform for AI. 📈

hub-sdk

Retired Python SDK for the shut-down Ultralytics HUB API, kept for reference; build new integrations on the Ultralytics Platform REST API

skyulf-core

Stop trusting your pipeline. Verify it; visually on a canvas or in Python. Self-hosted platform + library. Now, you can be able use it in Databricks and MLFlow with bundle option.

compileml

Compile tree-ensemble models into deterministic, auditable decision artifacts — score, calibrated PD, risk bands, and adverse-action reason codes in one hashed JSON that produces identical integers in Python, SQL, and COBOL.

nbox

The official python package for NimbleBox. Exposes all APIs as CLIs and contains modules to make ML 🌸

cleanlab-studio

Client interface to Cleanlab Studio

fastdeploy

Deploy DL/ ML inference pipelines with minimal extra code.

busysloths-mlox

Deploy and manage ML/AI infrastructure on your own servers. Slothfully simple.

geti-sdk

⚠️ [Deprecated] SDK for the Geti™ platform (v2.x only)

fedml

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

chitra

A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.

modelscout-llm

ModelScout checks your hardware and gives you a shortlist before you download the weights. You can scan your own machine or supply a different GPU and memory size to see what might fit.

spacepilot

Autonomous model-to-production infrastructure

solo-server

CLI for Physical AI Specialization

monai-deploy-app-sdk

MONAI Deploy App SDK offers a framework and associated tools to design, develop and verify AI-driven applications in the healthcare imaging domain.

tungstenkit

ML container made simple

fdclient

Deploy DL/ ML inference pipelines with minimal extra code.

canary-ml

Drift and anomaly detection for production ML models

modelgate-py

Containerized machine learning inference API and Python SDK. Instantly serve tabular ML models (Scikit-Learn/Joblib) dynamically from URLs with strict JSON schema validation and error shielding.

cleanlab-cli

Client interface to Cleanlab Studio

pinferencia

Python + Inference - Model Deployment library in Python. Simplest model inference server ever.

bentoctl

Fast model deployment on any cloud 🚀

modzy-sdk

Python library for Modzy Machine Learning Operations (MLOps) Platform