Qlora Python Packages

bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

experts4bit-qlora

Fine-tune and serve large Mixture-of-Experts models on one GPU, with 4-bit experts in GPU memory, RAM or SSD.

grouped-nf4-gemm

4-bit GPU kernels that compute directly on packed Mixture-of-Experts weights, for training and inference.

soup-cli

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

airllm

AirLLM 70B inference with single 4GB GPU

backpropagate

Headless LLM fine-tuning in 3 lines — smart defaults, VRAM-aware batch sizing, multi-run SLAO, GGUF export for Ollama.

loggetta

Plan and run Mixture-of-Experts fine-tuning on one GPU: check the machine, fit the model, and keep a report of each run.

miniverl

verl for a single consumer GPU. PPO, GRPO and on-policy distillation on NVIDIA GPUs.

mlx-train-perf

Fused, logit-free linear-cross-entropy loss, RAM-fit planner, and benchmark harness for MLX fine-tuning on Apple Silicon

canifinetune

Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.

tinyforge

Fine-tune an 8B LLM on a 4 GB laptop GPU, check it with real quality gates, and serve it (pip install tinyforge)

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llm-forge-new

Config-driven, YAML-first open-source LLM training platform. Fine-tune language models by editing a single YAML file.

maatml

Turn a multi-gigabyte base model into a small subject-matter expert you can run anywhere. One model.yml drives prepare, train, evaluate, export, and serve, with validators checking correctness outside the model at each stage.

forgelm

Config-driven LLM fine-tuning with safety evaluation, EU AI Act compliance, 6 alignment methods, and one-command bundled quickstart templates.

shadowlm

A fine-tuning SDK — any open model, any harness, any method. 12 training methods behind one argument; pure-stdlib core.

llm-toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

ftdoctor

Did your fine-tune overfit? Which checkpoint should you keep? What can you delete? For any HuggingFace Trainer run, local or on the Hub: TRL, Unsloth, LLaMA-Factory, Axolotl.

moroai

MoroAI is a local-first model adaptation foundry for building, evaluating, and deploying private small language models from your own data.

textpolicy

Reinforcement learning for text generation on MLX (Apple Silicon)

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

llm-gpu-lab

One GPU. Full LLM workflow. Real benchmarks. No cloud required.

glmtuner

Fine-tuning ChatGLM-6B with PEFT | 基于 PEFT 的高效 ChatGLM 微调