tokenisation
Ungreedy subword tokenizer and vocabulary trainer for Python, Go, C++ & Javascript
Python-based runner for omorfi (and other FSA morphologies)
Taiwanese Hokkien Transliterator and Tokeniser
