Sentence Tokenizer Python Packages

ja-sentence-segmenter

japanese sentence segmentation library for python

bunkai

Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)

sengiri

Yet another sentence-level tokenizer for the Japanese text

hasami

A tool to perform sentence segmentation on Japanese text

nlptoolkit-corpus

Corpus processing library

vngrs-nlp

State-of-the-art, lightweight NLP tools for Turkish language. Developed by VNGRS.

nlptoolkit-corpus-cy

Corpus Processing Library

tokenizesentences

Tiny, dependency-free English sentence tokenizer.

cleave-sbd

Fast, zero-dependency sentence boundary disambiguation (SBD) built for C-level execution speed.

trtokenizer

🧩 A simple sentence tokenizer.

py-hasami

A tool to perform sentence segmentation on Japanese text