Sentence Segmentation Python Packages

sentencex

A sentence segmentation library with wide language support optimized for speed and utility.

razdel

Rule-based token, sentence segmentation for Russian language

natasha

Solves basic Russian NLP tasks, API for lower level Natasha projects

wtpsplit

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

wtpsplit-lite

✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models

yasbd-lib

A high-accuracy, multilingual rule-based Sentence Boundary Detector (SBD) with a drop-in adapter for pysbd, delivering faster and more accurate sentence segmentation.

sentsplit

A flexible sentence segmentation library using CRF model and regex rules

fast-sentence-segment

Fast and Efficient Sentence Segmentation

hasami

A tool to perform sentence segmentation on Japanese text

nlptoolkit-corpus

Corpus processing library

trankit

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

mawo-razdel

Продвинутая токенизация для русского языка с SynTagRus паттернами

hellonlp

NLP tools, word segmentation, sentence segmentation， New-Word-Discovery，新词发现

nlptoolkit-corpus-cy

Corpus Processing Library

khmerpunctuate

Punctuation Restoration for Khmer language

tokenizesentences

Tiny, dependency-free English sentence tokenizer.

meitei-senter

Neural sentence boundary detection for Meitei Mayek (Manipuri) using SentencePiece tokenization and a CNN-based spaCy pipeline.

cleave-sbd

Fast, zero-dependency sentence boundary disambiguation (SBD) built for C-level execution speed.

prose-tokenizer

High-precision prose and Markdown tokenization for natural language processing.

b-labs-models

Pre-trained models for tokenization, sentence segmentation and so on

ortix-seg

Runtime package for Ortix. Ortix is a growing family of models for Latvian text-processing pipelines: sentence segmentation, correction, punctuation, and normalization.

py-hasami

A tool to perform sentence segmentation on Japanese text

syntaxcomp

A Python3 package for extracting syntactic complexity measures from CoNLL-U annotations.

spacyss

Sentence Segmentation for Spacy