PyRank

Inter Annotator Agreement Python Packages

Python packages with the GitHub topic inter-annotator-agreement. Sorted by relevance, with stars and monthly downloads.
pln-fing-udelar
krippendorff

Fast computation of Krippendorff's alpha agreement measure in Python.

92K 158 18
tr7200
kappaiou

A training-free, chance-corrected reliability library for continuous multi-object spatial annotations.

597 0 0
CrowdTruth
crowdtruth

Disagreement based metrics for the processing and evaluation of crowdsourced annotations

351 63 11
kldtz
bratiaa

Inter-annotator agreement for Brat annotation projects

242 22 7
auraoneai
iaa-kit

Modern inter-annotator agreement metrics with bootstrap confidence intervals.

161 0 0
auraoneai
synthetic-disagreement

Controlled synthetic annotator disagreement generator.

154 0 0
CrowdTruth
crowdtruth-fork

Disagreement based metrics for the processing and evaluation of crowdsourced annotations

132 63 11