Mutual Information Python Packages

infomeasure

Python package for calculating various information measures, including entropy, mutual information, transfer entropy, and more, with support for both discrete and continuous variables.

dependence-forecastability

General-purpose Python toolkit for horizon-wise forecastability analysis using interchangeable dependence scorers, with AMI/pAMI support, rolling-origin benchmarking, and reproducible reporting.

spkit

Signal Processing Toolkit, including ML models with visualization

ennemi

Easy Nearest Neighbor Estimation of Mutual Information

gmm-mi

Estimation of mutual information (MI) distribution with Gaussian mixture models (GMMs)

copent

Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Mutual Information), and the statistics for multivariate normality test and two-sample test, and change point detection in Python

pymrmr

Python3 binding to mRMR Feature Selection algorithm (currently not maintained)

mafese

Feature Selection using Metaheuristics Made Easy: Open Source MAFESE Library in Python

jax-pcmci

High-performance causal discovery using PCMCI algorithms with JAX acceleration

pytorch-mighty

The Mighty Monitor Trainer for your pytorch models.

depynd

Evaluating dependencies among random variables.

infotopo

computes most of information functions (joint entropy, conditional, mutual information, total correlation information distance) and deep information networks

gemclus

A package for performing discriminative clustering with gemini-trained models

expression-copilot

Quantifying predictability of gene expression from histology image

dse-dsmi

Diffusion spectral entropy and diffusion spectral mutual information (https://arxiv.org/abs/2312.04823).

migt

Model-agnostic dataset partitioning using Mutual Information

sjaracne

Gene network reverse engineering from big data

minfo

Python-based mutual information estimator, designed for multiple data types.

colin-mico

MICO: Mutual Information and Conic Optimization for feature selection.

mica

Mutual Information-based Clustering Analysis tool designed for scRNA-seq data

rsmine

A Python package for efficient optimisation of real-space renormalization group transformations using Tensorflow.

miga

Python package to optimize mutual information between two multiple sequence alignment.