Rlhf Python Packages

llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

transformerlab

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

image-reward

[NeurIPS 2023] ImageReward: Learning and Evaluating Human Preferences for Text-to-image Generation

transformerlab-cli

The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.

rubrix

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets

py-openjudge

OpenJudge: A Unified Framework for Holistic Evaluation and Quality Rewards

trinity-rft

Trinity-RFT is a general-purpose, flexible and scalable framework designed for reinforcement fine-tuning (RFT) of large language models (LLM).

kiln-ai

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

argilla-server

Open-source tool for exploring, labeling, and monitoring data for NLP projects.

mlx-lm-lora

Train LLMs on Apple silicon with MLX and the Hugging Face Hub

textrl

TextRL - reinforcement learning for text generation, built on HuggingFace TRL.

log10-io

Python client library for improving your LLM app accuracy

kiln-server

Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

llmtuner

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

openpo

Build high quality synthetic datasets with AI feedback from 200+ LLMs

lazyllm-llamafactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

oat-llm

Online AlignmenT (OAT) for LLMs.

alignment-handbook

Robust recipes to align language models with human and AI preferences

aepo

Code of Annotation-Efficient Language Model Alignment via Diverse and Representative Response Texts (EMNLP Findings 2025)

knowlyr-datalabel

Serverless annotation framework with LLM pre-labeling, inter-annotator agreement analysis & offline HTML interface. CLI + MCP ready.

argilla-v1

Open-source tool for exploring, labeling, and monitoring data for NLP projects.

instruct-goose

Implementation of Reinforcement Learning from Human Feedback (RLHF)

lmxlab

Transformer language models on Apple Silicon with MLX

mlora-cli

An Efficient "Factory" to Build Multiple LoRA Adapters