Tokenizer Free Python Packages

hsl-embedding

Non-learned byte-level signal encoder for PyTorch - one modality-agnostic 27-D exact base (anchor rule, Delta = Gray code), losslessly invertible. pip install hsl-embedding

precious-nlp

A tokenizer-free NLP library with T-FREE, CANINE, and byte-level approaches