turboBPE is a fast, minimal Byte Pair Encoding (BPE) tokenizer built on minbpe. It features a C-accelerated backend and a batch-merging algorithm to drastically speed up training while maintaining a clean, hackable codebase. Perfect for training custom vocabularies from scratch.
