Llm Training Python Packages

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

liger-kernel

Efficient Triton Kernels for LLM Training

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

adafactor8bit

8-bit Adafactor Optimizer with Fused CUDA Kernels

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

apollo-torch

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

trainy-skypilot-nightly

SkyPilot: An intercloud broker for the clouds

ntloss

PyPI package for Number Token Loss (ICML 2025)

autotransformers

A Python package for automatically training and comparing language models.

embedding-condensation

[𝗜𝗖𝗠𝗟 𝟮𝟬𝟮𝟲] Dispersion loss counteracts embedding condensation and improves generalization in small language models

tsugi-mend

tsugiai-mend-sdk. Maximum-uplift cross-rack distributed-training reducer built on Decoupled DiLoCo + DES-LOC + async tensor parallelism + FALCON fail-slow mitigation. Patent-independent by deliberate construction; see LICENSE preamble.

safety-compass

Detect safety degradation during LLM fine-tuning before it becomes behavioral

llm-magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

tsugi

Unified developer surface for TsugiCinema's open-source distributed-training SDKs. pip install tsugi pulls tsugi-mend (Apache-2.0; patent-independent) and tsugi-kpool (Apache-2.0; patent-aligned) and re-exports both under one namespace.

forgellm

A comprehensive toolkit for end-to-end continued pre-training, fine-tuning, monitoring, testing and publishing of language models with MLX-LM

atorch

DLRover: An Automatic Distributed Deep Learning System

llm-trainer

🤖 Train your LLMs with ease and fun.

alignmenter

Check if your AI sounds like your brand, stays safe, and behaves consistently. Works with your custom GPTs, hosted APIs, and local models. Get detailed reports in minutes, not days.

dlrover

DLRover: An Automatic Distributed Deep Learning System

candyllm

CandyLLM: Unified framework for HuggingFace and OpenAI Text-generation Models

audiotoken

Audio tokenization, in the fastest way possible!

ac-scheduler

SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper. (Fork by Jason-AC)