Llm Training Python Packages

skypilot

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

liger-kernel

Efficient Triton Kernels for LLM Training

skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

yunchang

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

trainy-skypilot-nightly

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

apollo-torch

APOLLO: SGD-like Memory, AdamW-level Performance; MLSys'25 Oustanding Paper Honorable Mention

ntloss

Number Token Loss - A regression-alike loss to improve numerical reasoning in language models

autotransformers

A Python package for automatically training and comparing language models.

llm-magnet

the small distributed language model toolkit; fine-tune state-of-the-art LLMs anywhere, rapidly

atorch

DLRover: An Automatic Distributed Deep Learning System

candyllm

CandyLLM: Unified framework for HuggingFace and OpenAI Text-generation Models

forgellm

A comprehensive toolkit for end-to-end continued pre-training, fine-tuning, monitoring, testing and publishing of language models with MLX-LM

alignmenter

Check if your AI sounds like your brand, stays safe, and behaves consistently. Works with your custom GPTs, hosted APIs, and local models. Get detailed reports in minutes, not days.

llm-trainer

🤖 Train and evaluate LLMs with ease and fun 🦾

ac-scheduler

SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper. (Fork by Jason-AC)

sillm-mlx

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

nextai-prism

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

dlrover

DLRover: An Automatic Distributed Deep Learning System

audiotoken

Audio tokenization, in the fastest way possible!

llama-trainer

Llama Trainer Utility

skypilot-mithril

SkyPilot: Run AI on Any Infra — Unified, Faster, Cheaper.

obs2nlm

A simple tool to make a Google NotebookLM source from an Obsidian vault