Uncertainty Estimation Python Packages

ngboost

Natural Gradient Boosting for Probabilistic Prediction

quantile-forest

Quantile Regression Forests compatible with scikit-learn.

uncertainty-toolbox

Uncertainty Toolbox: a Python toolbox for predictive uncertainty quantification, calibration, metrics, and visualization

uqlm

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

puncc

👋 Puncc is a python library for predictive uncertainty quantification using conformal prediction.

xgboostlss

An extension of XGBoost to probabilistic modelling

pygpc

A Sensitivity and uncertainty analysis toolbox for Python based on the generalized polynomial chaos method

lightgbmlss

An extension of LightGBM to probabilistic modelling

bayesian-torch

A library for Bayesian neural network layers and uncertainty estimation in Deep Learning extending the core of PyTorch

adfwi-torch

An Automatic Differentiation-based Waveform Inversion Framework Implemented in PyTorch.

nlp-uncertainty-zoo

Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.

calibrain

Python framework for uncertainty estimation and calibration in EEG/MEG inverse source imaging.

torchbayesian

PyTorch-native Bayesian neural networks for uncertainty quantification in deep learning

photonai-conformal

Conformal Predictions using photonai

robust-deep-learning

A project to train your model from scratch or fine-tune a pretrained model using the losses provided in this library to improve out-of-distribution detection and uncertainty estimation performances. Calibrate your model to produce enhanced uncertainty estimations. Detect out-of-distribution data using the defined score type and threshold.

seapig

Selective prediction based on uncertainty scores

sentinelml

Runtime trust layer for machine learning systems that evaluates prediction reliability in real-world environments.

masksembles

Official repository for the paper "Masksembles for Uncertainty Estimation" (CVPR 2021).

ngboost-release

Natural Gradient Boosting for Probabilistic Prediction

kid-ppg

KID-PPG package for heart rate extraction from photoplethysmography signals

muben

Benchmark for molecular uncertainty estimation.