nlp-libary
Sudachi in Rust 🦀 and new generation of SudachiPy
A fast, minimal BPE tokenizer for NLP research.