Confidence Estimation Python Packages

uqlm

[JMLR 2026] UQLM: A Python package for LLM hallucination detection using uncertainty quantification

pytorch-ood

👽 Out-of-Distribution Detection with PyTorch

duvida

🧐 Calculating exact and approximate confidence and information metrics for deep learning on general purpose and chemistry tasks.

cake-ensemble

Confidence in Assignments via K-partition Ensembles

garrus

Python framework for high quality confidence estimation of deep neural networks, providing methods such as confidence calibration and ordinal ranking

relistats

Computation of Reliability Statistics: Reliability, Confidence, Assurance

macest

Model Agnostic Confidence Estimator (MACEST) - A Python library for calibrating Machine Learning models' confidence scores