Qlora Python Packages

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

airllm

AirLLM 70B inference with single 4GB GPU

soup-cli

Soup turns the pain of LLM fine-tuning into a simple workflow. One config, one command, done.

shadowlm

A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

backpropagate

Headless LLM fine-tuning in 3 lines — smart defaults, VRAM-aware batch sizing, multi-run SLAO, GGUF export for Ollama.

llm-forge-new

Config-driven, YAML-first open-source LLM training platform

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

document-language-model

Document-first local LLM training, preference mining, retraining, and multi-target export from .dlm docs, codebases, and multimodal sources.

textpolicy

Reinforcement learning for text generation on MLX (Apple Silicon)

canifinetune

Estimate whether a Hugging Face model fits and fine-tunes on your local GPU.

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llm-toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

llm-gpu-lab

One GPU. Full LLM workflow. Real benchmarks. No cloud required.

glmtuner

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调

easylora

Batteries-included toolkit for LoRA / QLoRA fine-tuning with Hugging Face Transformers

groundcortex

Automated thought consolidation engine for AI agents using LoRA fine-tuning

llamafactory-songlab

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

readme-ready

Auto-generate code documentation in Markdown format in seconds.

bitsandbytes-intel

Intel-optimized version of bitsandbytes