Lora Python Packages

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

loralib

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

ms-swift

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.6, DeepSeek-R1, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Gemma4, Llava, Phi4, ...) (AAAI 2025).

transformerlab

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

adapters

A Unified Library for Parameter-Efficient and Modular Transfer Learning

hud-python

OSS RL environment + evals toolkit

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

pycayennelpp

A Cayenne Low Power Payload (CayenneLPP) decoder and encoder for Python

airllm

AirLLM 70B inference with single 4GB GPU

transformerlab-cli

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

mcore-bridge

MCore-Bridge: Providing Megatron-Core model definitions for state-of-the-art large models and making Megatron training as simple as Transformers — with support for 300+ large language models and 200+ multimodal large models.

chatllm

轻松玩转LLM兼容openai&langchain，支持文心一言、讯飞星火、腾讯混元、智谱ChatGLM等

nomadnet

Communicate Freely

datasetrising

Toolchain for creating custom datasets and training Stable Diffusion (1.x, 2.x, XL) models and LoRAs

mlx-tune

Fine-tune LLMs on your Mac with Apple Silicon. SFT, DPO, GRPO, Vision, TTS, STT, Embedding, and OCR fine-tuning — natively on MLX. Unsloth-compatible API.

lorax-client

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

aphrodite-engine

Large-scale LLM inference engine

adapter-transformers

A Unified Library for Parameter-Efficient and Modular Transfer Learning

rose-opt

🌹 Rose: Range-Of-Slice Equilibration PyTorch optimizer. Stateless optimization through range-normalized gradient updates.

onediff

an out-of-the-box acceleration library for diffusion models

loudify

Loudify, LoRa cloudified. This repo is a python package to run a GNU Radio flow graph in a client <-> broker <-> worker context. The idea behind this project is to get a Centralized Radio Access Network (CRAN) for LoRa.

fetchtastic

Fetchtastic is a utility for downloading and managing the latest Meshtastic Android app and Firmware releases on your PC and/or phone (using Termux). It also provides optional notifications via NTFY.

phi-3-vision-mlx

Phi-3-Vision on Apple silicon with MLX