agreement
Fast computation of Krippendorff's alpha agreement measure in Python.
Inter-annotator agreement measure and alignment written in python
Kupper-Hafner inter-rater agreement calculation library