kappa
Tool suite for kappa models. Documentation and binaries can be found in the release section. Try it online at
Attribute eval-score movement to the system or the LLM judge using a frozen human anchor set and kappa.
Kupper-Hafner inter-rater agreement calculation library