Human Feedback Python Packages

palm-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

pushback

How often do you correct your coding agent, and on what kind of work? Measures it from your Claude Code transcripts, drafts CLAUDE.md rules from your recurring corrections, and exports them as preference pairs.

personagent

A group-chat character that knows when to stay quiet and learns from being corrected, with an evidence ledger, rollback and a measured eval. QQ, Telegram, Discord and more through AstrBot, Koishi or Matrix.

grandjury

Pluralistic human evaluation infrastructure for AI in production

awaithumans

Pause your AI agent. Ask a human. Resume with their answer. Open source human-in-the-loop (HITL) library for production LLM agents: Slack, email, and web dashboard. Typed Pydantic and Zod responses. Durable Temporal and LangGraph adapters. AI verifier. Audit trail. Self-hosted, Apache 2.0. Python and TypeScript.

auraone-evalkit

Local-first AI evaluation and robotics review tools: EvalKit, Robotics ReviewKit, release evidence, and technical buying resources.

instruct-goose

Implementation of Reinforcement Learning from Human Feedback (RLHF)

alignmap

Documentation at