Unicode Python Packages

idna

Internationalized Domain Names for Python (IDNA 2008 and UTS #46)

charset-normalizer

Truly universal encoding detector in pure Python.

pylatexenc

Simple LaTeX parser providing latex-to-unicode and unicode-to-latex conversion

stringzilla

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

anyascii

Unicode to ASCII transliteration - C Elixir Go Java JS Julia PHP Python Ruby Rust Shell .NET

pyunormalize

Unicode normalization forms (NFC, NFD, NFKC, NFKD). A pure-Python implementation independent of Python’s core Unicode database, supporting version 17.0 of the Unicode Standard.

confusable-homoglyphs

ϲοｎｆｕѕаｂｌе＿һοｍоɡｌｙｐｈｓ

idna-ssl

Patch ssl.match_hostname for Unicode(idna) domains support

tangled-up-in-unicode

Access to the Unicode Character Database (UCD)

demoji

Accurately find/replace/remove emojis in text strings

pyuca

a Python implementation of the Unicode Collation Algorithm

plotille

Plot in the terminal using braille dots.

normality

A tiny library for Python text normalisation. Useful for ad-hoc text processing.

tendo

Official repository of python tendo library, always welcoming new contributions.

morphys

Smart conversions between unicode and bytes types for common cases in python.

rtfunicode

Encoder for unicode to RTF 1.5 command sequences

pyboxen

Incredibly customizable terminal boxes for Python

flake8-encodings

A Flake8 plugin to identify incorrect use of encodings.

table2ascii

An intuitive and type-safe Python library for converting lists to fancy ASCII tables for displaying in the terminal or code-blocks

uniplot

Lightweight plotting to the terminal. 4x resolution via Unicode.

pyonmttok

Fast and customizable text tokenization library with BPE and SentencePiece support

unicodeit

Converts LaTeX tags to unicode: \mathcal{H} → ℋ. Available on the web or as Automator script for the Mac.

homoglyphs

Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.

navi-sanitize

Deterministic input sanitization for untrusted text — invisible characters, homoglyphs, and encoding tricks, handled before your code sees them. Zero dependencies, no ML. Python 3.12+.