Llama Python Packages

sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

torchao

PyTorch native quantization for training and inference

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

strands-agents-tools

A set of tools that gives agents powerful capabilities.

unsloth-zoo

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

sglang-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

curated-transformers

🤖 A PyTorch library of curated Transformer models and their composable components

liger-kernel

Efficient Triton Kernels for LLM Training

aider-chat

aider is AI pair programming in your terminal

gptcache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

sgl-kernel

SGLang is a high-performance serving framework for large language models and multimodal models.

strands-agents-builder

An example agent demonstrating streaming, tool use, and interactivity from your terminal. This agent builder can help you to build your own agents and tools.

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, Phi4, ...) (AAAI 2025).

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

tensorzero

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

astrbot

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

vllm-cpu-nightly

A high-throughput and memory-efficient inference and serving engine for LLMs

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

fuzy-jon

Fuzzy-JSON is a compact Python package with no dependencies, designed to address the pesky JSONDecodeError that sometimes occurs when utilizing OpenAI's powerful call function.

vllm-tpu

A high-throughput and memory-efficient inference and serving engine for LLMs

agentmake

AgentMake AI: a kit for developing agentic AI applications that support 24 AI backends and and work with 7 agentic components, such as tools and agents. (Developer: Eliran Wong) Supported backends: anthropic, azure, azure_any, cohere, custom, deepseek, genai, github, github_any, googleai, groq, llamacpp, mistral, ollama, openai, vertexai, xai

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

paddlenlp

Easy-to-use and powerful LLM and SLM library with awesome model zoo.