Fine Tuning Python Packages

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

llama-index-core

LlamaIndex is the document processing platform for AI

llama-index-instrumentation

LlamaIndex is the document processing platform for AI

llama-index

LlamaIndex is the document processing platform for AI

llama-index-legacy

LlamaIndex is the document processing platform for AI

unsloth-zoo

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

unsloth

Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.

flyteidl

Type-safe, distributed orchestration of agents, ML pipelines, and real-time inference on your k8s — in pure Python with async/await, also other languages (rust, go and ts)

kubeflow

Universal Python SDK to run AI workloads on Kubernetes

dstack

A unified orchestration layer for heterogeneous AI compute. It standardizes how to manage compute and run training and inference on GPU clouds, Kubernetes, VMs, or bare-metal clusters.

kubeflow-training

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

kubeflow-trainer-api

Distributed AI Model Training and LLM Fine-Tuning on Kubernetes

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

experts4bit-qlora

Fine-tune and serve large Mixture-of-Experts models on one GPU, with 4-bit experts in GPU memory, RAM or SSD.

adv-optm

A family of highly efficient, lightweight yet powerful optimizers.

freesolo-flash-dev

LoRA post-training for open-weight models: SFT, GRPO, and on-policy distillation. Describe a run in TOML; Flash allocates a GPU, trains, streams checkpoints, and serves the adapter.

dtflow

Inspect, clean, transform and ship LLM training data from one CLI; dt view is the interactive entry point.

convmerge

Merge heterogeneous chat/text sources into a single LLM training format (JSONL)

soup-cli

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

axolotl

Go ahead and axolotl questions

overmind

The platform for continuously improving AI agents.

oumi

Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

openllm

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

finetuning-scheduler

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.