Gpt Oss Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

unsloth

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

unsloth-zoo

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

sgl-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

tokenspeed-mla

TokenSpeed is a speed-of-light LLM inference engine.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

mcore-bridge

MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models and 200+ multimodal large models.

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

leann

[MLsys2026]: RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

tokenspeed-smg

TokenSpeed is a speed-of-light LLM inference engine.

sglang-kt

SGLang is a high-performance serving framework for large language models and multimodal models.

oumi

Easily fine-tune, evaluate and deploy Gemma 4, Qwen3.5, Qwen3.6, gpt-oss, DeepSeek-R1, or any open source LLM / VLM!

xtuner

A Next-Generation Training Engine Built for Ultra-Large MoE Models

unsloth-studio

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

agentsculptor

AgentSculptor: Refactor, restructure & modernize codebases with natural language — powered by GPT-OSS and vLLM.

ai-dynamo-vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

dblcsgen

SGLang is a high-performance serving framework for large language models and multimodal models.

vllm-acc

A high-throughput and memory-efficient inference and serving engine for LLMs

vllm-xft

A high-throughput and memory-efficient inference and serving engine for LLMs

ggufloader

GGUF Loader with its Agentic Mode, and floating button, ai Models | Open Source & Offline. Mistral, Deepseek, llama, gemma, qwen

indigo-print

Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.

wxy-test

A high-throughput and memory-efficient inference and serving engine for LLMs