Information Theory Python Packages

infomap

Multi-level network clustering based on the Map Equation

entropyhub

An open-source toolkit for entropic data analysis.

infomeasure

Python package for calculating various information measures, including entropy, mutual information, transfer entropy, and more, with support for both discrete and continuous variables.

corextopic

Hierarchical unsupervised and semi-supervised topic models for sparse count data with CorEx

komm

An open-source library for Python 3 providing tools for analysis and simulation of analog and digital communication systems.

kxy

A toolkit to boost the productivity of machine learning engineers.

ennemi

Easy Nearest Neighbor Estimation of Mutual Information

conaction

Efficient implmenetations of instantiations of the Trinity of Covariation.

thoi

THOI: An efficient library for higher order interactions analysis based on Gaussian copulas enhanced by batch-processing

driada

Dimensionality Reduction for Integrated Activity Data Analysis

spkit

Signal Processing Toolkit, including ML models with visualization

rgclib

Recursive Group Coding (RGC): fast entropy coder with better compression than AC/Huffman on large alphabets – C lib + Python package

p4j

Periodic light curve analysis tools based on Information Theory

copent

Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Mutual Information), and the statistics for multivariate normality test and two-sample test, and change point detection in Python

lempel-ziv-complexity

:package: Lempel-Ziv Complexity, fast implementations with :snake: Python (naive, Numba or Cython for speedup), Open-Source (MIT) :+1: →

arithmetic-compressor

Arithmetic coding library with statistical models like PPM and Context mixing (demonstrating core principles of probabilistic inference, ensemble learning in AI)

frites

Framework for Information Theoretical analysis of Electrophysiological data and Statistics

depynd

Evaluating dependencies among random variables.

shifterator

Interpretable data visualizations for understanding how texts differ at the word level

infotopo

computes most of information functions (joint entropy, conditional, mutual information, total correlation information distance) and deep information networks

dstz

一个轻量、易用的Python证据理论库，专注于Dempster-Shafer理论及其扩展。

infotheory-rs

An Algorithmic Information Theory Library (And Information-theory broadly); Implements numerous approximations, estimations, as well as a comprehensive MC-AIXI Agent & Model Ensemble platform.

causationentropy

Implementation of Causation Entropy from Clarkson Center for Complex Systems Science (C3S2)

rke-score

Compute Renyi Kernel Entropy scores (RKE-MC and RRKE) for two sets of vectors.