Gpt Oss Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

tokenspeed-mla

TokenSpeed is a speed-of-light LLM inference engine.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

mcore-bridge

MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.3, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.8, Qwen3-Omni, Gemma4, ...).

oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

tokenspeed-cutedsl-kda

TokenSpeed is a speed-of-light LLM inference engine.

leann

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

bridgenode-llm

BridgeNode — x402 pay-per-request AI inference. Python SDK.

gpt-oss-azure-opencode-shim

HTTP shim that fixes silent tool_choice failures between OpenCode and Azure-hosted GPT-OSS models

sglang-kt

SGLang is a high-performance serving framework for large language models and multimodal models.

geniex

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

lsglang

SGLang is a high-performance serving framework for large language models and multimodal models.

geniex-llama-cpp

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

bridgenode-cli

BridgeNode — x402 pay-per-request AI inference. Python SDK.

geniex-qairt

Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

bridgenode-mcp

BridgeNode — x402 pay-per-request AI inference. MCP server for AI agents.

bridgenode

BridgeNode — x402 pay-per-request AI inference. Python SDK.

bridgenode-sdk

BridgeNode — x402 pay-per-request AI inference. Python SDK.