Lora Python Packages

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

transformerlab

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

mcore-bridge

MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models (Qwen3-Next, GLM-5.1, Deepseek-V4, MiniMax-2.7, ...) and 200+ multimodal large models (Qwen3.5, Qwen3-Omni, Gemma4, ...).

tessera-hypernetwork

Generate per-session LoRA adapters in <1s for agentic inference efficiency.

pycayennelpp

A Cayenne Low Power Payload (CayenneLPP) decoder and encoder for Python

airllm

AirLLM 70B inference with single 4GB GPU

chatllm

轻松玩转LLM兼容openai&langchain，支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

nomadnet

Communicate Freely

lorax-client

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

transformerlab-cli

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

shadowlm

A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

adapter-transformers

A Unified Library for Parameter-Efficient and Modular Transfer Learning

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

onediff

OneDiff: An out-of-the-box acceleration library for diffusion models.

bee-sdk

Open community repository for Bee by CUI Labs — public code, developer tooling, documentation, examples, and community-facing components for building with and contributing to Bee.

onediffx

OneDiff: An out-of-the-box acceleration library for diffusion models.

fetchtastic

Fetchtastic is a utility for downloading and managing the latest Meshtastic Android app and Firmware releases on your PC and/or phone (using Termux). It also provides optional notifications via NTFY.