Information Theory Python Packages

infomap

Multi-level network clustering based on the Map Equation

scientific-computing-system-2-0

Scientific computing platform on NumPy/SciPy/pandas/matplotlib: linear algebra, stats, optimization, signals, ML, information theory, chaos, Bayes, metaheuristics, geometry and RL.

corextopic

Hierarchical unsupervised and semi-supervised topic models for sparse count data with CorEx

dit

**dit** is a Python package for information theory.

entropyhub

An open-source toolkit for entropic data analysis.

kxy

A toolkit to boost the productivity of machine learning engineers.

omni-compress

Lossless source-code compression using neural prediction and structural redundancy.

relate-search

Code similarity search by compression - find near-duplicate files, clone families, and where a pasted snippet came from. No embeddings, no model, no vector database.

komm

An open-source library for Python 3 providing tools for analysis and simulation of analog and digital communication systems.

infomeasure

Python package for calculating various information measures, including entropy, mutual information, transfer entropy, and more, with support for both discrete and continuous variables.

frites

Framework for Information Theoretical analysis of Electrophysiological data and Statistics

driada

Dimensionality Reduction for Integrated Activity Data Analysis

conaction

A package for studying how things change together.

copent

Estimating Copula Entropy (Mutual Information), Transfer Entropy (Conditional Mutual Information), and the statistics for multivariate normality test and two-sample test, and change point detection in Python

pyrazobill

Lossless log compaction engine and exact information ledger in C++20 with DuckDB and Python extensions

spkit

Signal Processing Toolkit, including ML models with visualization

rgclib

Recursive Group Coding (RGC): fast entropy coder with better compression than AC/Huffman on large alphabets – C lib + Python package

p4j

Periodic time series analysis tools based on information theory

thoi

THOI: An efficient library for higher order interactions analysis based on Gaussian copulas enhanced by batch-processing

nested-recd

Nested ordinal RECD: Φ1–Φ3 conjunction levels and λ-weighted Discrete Extramental Clock

lempel-ziv-complexity

:package: Lempel-Ziv Complexity, fast implementations with :snake: Python (naive, Numba or Cython for speedup), Open-Source (MIT) :+1: →

ennemi

Easy Nearest Neighbor Estimation of Mutual Information

mdl-fca

Learning compact concept DAGs from binary data by minimum description length — a probabilistic take on Formal Concept Analysis

depynd

Evaluating dependencies among random variables.