Unicode Python Packages

idna

Internationalized Domain Names for Python (IDNA 2008 and UTS #46)

charset-normalizer

Truly universal encoding detector in pure Python.

pylatexenc

Simple LaTeX parser providing latex-to-unicode and unicode-to-latex conversion

anyascii

Unicode to ASCII transliteration - C Elixir Go Java JS Julia PHP Python Ruby Rust Shell .NET

pyunormalize

Unicode normalization forms (NFC, NFD, NFKC, NFKD). A pure-Python implementation independent of Python’s core Unicode database, supporting version 17.0 of the Unicode Standard.

stringzilla

Up to 100x faster strings for C, C++, CUDA, Python, Rust, Swift, JS, & Go, leveraging NEON, AVX2, AVX-512, SVE, GPGPU, & SWAR to accelerate search, hashing, sorting, edit distances, sketches, and memory ops 🦖

confusable-homoglyphs

ϲοｎｆｕѕаｂｌе＿һοｍоɡｌｙｐｈｓ

idna-ssl

Patch ssl.match_hostname for Unicode(idna) domains support

tangled-up-in-unicode

Access to the Unicode Character Database (UCD)

demoji

Accurately find/replace/remove emojis in text strings

plotille

Plot in the terminal using braille dots.

normality

A tiny library for Python text normalisation. Useful for ad-hoc text processing.

pyuca

a Python implementation of the Unicode Collation Algorithm

morphys

Smart conversions between unicode and bytes types for common cases in python.

tendo

Official repository of python tendo library, always welcoming new contributions.

rtfunicode

Encoder for unicode to RTF 1.5 command sequences

pyboxen

Incredibly customizable terminal boxes for Python

flake8-encodings

A Flake8 plugin to identify incorrect use of encodings.

pyonmttok

Fast and customizable text tokenization library with BPE and SentencePiece support

table2ascii

An intuitive and type-safe Python library for converting lists to fancy ASCII tables for displaying in the terminal or code-blocks

text-unicoder

unicode text generator to make flip turned bold italic greek fraktur cursive script from ascii input

uniplot

Lightweight plotting to the terminal. 4x resolution via Unicode.

unicodeit

Converts LaTeX tags to unicode: \mathcal{H} → ℋ. Available on the web or as Automator script for the Mac.

homoglyphs

Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.