Sentence Segmentation Python Packages

sentencex

A sentence segmentation library with wide language support optimized for speed and utility.

razdel

Rule-based token, sentence segmentation for Russian language

natasha

Solves basic Russian NLP tasks, API for lower level Natasha projects

wtpsplit

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

wtpsplit-lite

✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models

yasbd-lib

Yasbd: A high-accuracy, rule-based Sentence Boundary Detector (SBD) with a drop-in adapter for pysbd, delivering faster and more accurate segmentation.

nlptoolkit-corpus

Corpus processing library

fast-sentence-segment

Fast and Efficient Sentence Segmentation

nlptoolkit-corpus-cy

Corpus Processing Library

hellonlp

NLP tools, word segmentation, sentence segmentation， New-Word-Discovery，新词发现

sentsplit

A flexible sentence segmentation library using CRF model and regex rules

hasami

A tool to perform sentence segmentation on Japanese text

trankit

Trankit is a Light-Weight Transformer-based Python Toolkit for Multilingual Natural Language Processing

mawo-razdel

Продвинутая токенизация для русского языка с SynTagRus паттернами

b-labs-models

Pre-trained models for tokenization, sentence segmentation and so on

prose-tokenizer

High-precision prose tokenization for natural language processing.

meitei-senter

Neural sentence boundary detection for Meitei Mayek (Manipuri) using SentencePiece tokenization and a CNN-based spaCy pipeline.

spacyss

Sentence Segmentation for Spacy

khmerpunctuate

Punctuation Restoration for Khmer language

py-hasami

A tool to perform sentence segmentation on Japanese text

wtpsplit-triton

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

syntaxcomp

A Python3 package for extracting syntactic complexity measures from CoNLL-U annotations.