filipino-language
The first, morphologically-aware subword tokenizer for Philippine languages, combining a structured linguistic affix data with BPE for language model pretraining.
Rephrase text via CLI 🤖