Finetuning Python Packages

liger-kernel

Efficient Triton Kernels for LLM Training

flaml

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

qianfan

Provide best practices for LMOps, as well as elegant and convenient access to the features of the Qianfan MaaS Platform. (提供大模型工具链最佳实践，以及优雅且便捷地访问千帆大模型平台）

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

nemo-automodel

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

finetuning-scheduler

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

tapeagents

TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle

finetuner

:dart: Task-oriented embedding tuning for BERT, CLIP, etc.

learn2learn

A PyTorch Library for Meta-learning Research

codefinetuner

Create your own local code autocomplete model, fine-tuned on your custom code repository, for use in editors like VS Code or Neovim.

datasety

CLI tool for dataset preparation: resize, align, caption, shuffle, synthetic, and mask generation.

openpo

Synthetic data for fine tuning LLM

phi-3-vision-mlx

Phi-3, -3.5, and -4 for Mac: Locally-run Vision and Language Models for Apple Silicon

fast-axolotl

High-performance Rust extensions for Axolotl (no OOM for large datasets) - drop-in acceleration for existing installations.

llama-recipes

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

quickllm

QuickLLM: Fast and Easy Fine-tuning for Popular Language Models

llm-toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

modeldiffr

Audit what changed between a base LLM and any fine tune, quant, merge, or edit. Behavioral diffs with confidence intervals today; representational and causal diffing next.

xturing

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

llmtune-local

Open-source tool (PyPI, MIT) to fine-tune LLMs and image models fully locally. Full stack solo: LoRA/QLoRA engine (PyTorch, HuggingFace PEFT/TRL, Apple Silicon/CUDA/CPU), FastAPI + React/TypeScript UI, Auth0 auth, GGUF export, CI. pip install llmtune-local

datasetpipeline

A data processing and analysis pipeline designed to handle various jobs related to data transformation, quality assessment, deduplication, and formatting.

open-retrievals

All-in-One: Text Embedding, Retrieval, Reranking and RAG in Transformers

llama-cookbook

Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services