Bradley Terry Python Packages

evalica

Evalica, your favourite evaluation toolkit

jev-sort

sort by meaning: order lines along a plain-English dimension, from pairwise comparisons judged by TypeSafe's Jev model

elote

Compare Elo, Glicko, TrueSkill, Bradley-Terry, and other rating algorithms behind a largely uniform Python interface.

evalaudit

Statistical validity checks for human-graded AI evaluations

pairsort

pairsort: rank anything with AI judges — many small pairwise questions, coupled into one calibrated ranking (PKPD / Bradley–Terry) on Jev-style judges

pairadigm

Concept-Guided Chain-of-Thought (CGCoT) pairwise annotation tool for systematic text evaluation using LLMs. Generate breakdowns, compare items, compute scores, and validate against human judgments. Supports Ollama, Hugging Face, Google Gemini, OpenAI, and Anthropic models.

arenakit

Bradley-Terry leaderboards with simultaneous confidence control — across 106,134 LMArena votes only 1 of 54 neighbouring pairs survives, against 5 when each is judged on its own.

climbing-ratings

route and climber ratings for rock climbing