Deployment Python Packages

ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

cdk-ecr-deployment

A CDK construct to deploy docker image to Amazon ECR

langserve

LangServe 🦜️🏓

ecs-deploy

Powerful CLI tool to simplify Amazon ECS deployments, rollbacks & scaling

inference-sdk

Turn any computer or edge device into a command center for your computer vision projects.

skein

A tool and library for easily deploying applications on Apache YARN

kedro-mlflow

A kedro-plugin for integration of mlflow capabilities inside kedro projects (especially machine learning model versioning and packaging)

action-platform

Your platform team, as a CLI. Scaffold, release and deploy on any stack and cloud; git-flow enforced; MCP for AI agents.

ray-cpp

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

luma-infra

Self-hosted deployment control plane for containers, powered by Nomad.

st2client

StackStorm (aka "IFTTT for Ops") is event-driven automation for auto-remediation, incident responses, troubleshooting, deployments, and more for DevOps and SREs. Includes rules engine, workflow, 160 integration packs with 6000+ actions (see https://exchange.stackstorm.org) and ChatOps. Installer at https://docs.stackstorm.com/install/index.html

inference

Turn any computer or edge device into a command center for your computer vision projects.

ant-ray-cpp-nightly

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

doctr

A tool for automatically deploying docs from Travis CI to GitHub pages.

settingspec

One file for all environments, all languages, all submodules.

inference-gpu

Turn any computer or edge device into a command center for your computer vision projects.

wasm-cli

Noust (formerly WASM): deploy and run web apps on your own Linux servers, and manage all of them from one central. The wasm command keeps working through 3.x.

mmdeploy

OpenMMLab Model Deployment Framework

leapp

library to quickly export and deploy entire inference pipelines

inference-cli

Turn any computer or edge device into a command center for your computer vision projects.

inference-cpu

Turn any computer or edge device into a command center for your computer vision projects.

xinference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

inference-core

Turn any computer or edge device into a command center for your computer vision projects.

noust

Noust (formerly WASM): deploy and run web apps on your own Linux servers, and manage all of them from one central. The wasm command keeps working through 3.x.