Sentence Segmentation Python Packages

sentencex

A sentence segmentation library with wide language support optimized for speed and utility.

razdel

Rule-based token, sentence segmentation for Russian language

natasha

Solves basic Russian NLP tasks, API for lower level Natasha projects

wtpsplit

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.

wtpsplit-lite

✂️ Sentence segmentation with wtpsplit's state-of-the-art Segment any Text (SaT) models

nlptoolkit-corpus

Corpus processing library

fast-sentence-segment

Fast and Efficient Sentence Segmentation

sentsplit

A flexible sentence segmentation library using CRF model and regex rules

trankit

Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing

nlptoolkit-corpus-cy

Corpus Processing Library

hellonlp

NLP tools, word segmentation, sentence segmentation， New-Word-Discovery，新词发现

hasami

A tool to perform sentence segmentation on Japanese text

prose-tokenizer

High-precision prose and Markdown tokenization for natural language processing.

b-labs-models

Pre-trained models for tokenization, sentence segmentation and so on

mawo-razdel

Продвинутая токенизация для русского языка с SynTagRus паттернами

spacyss

sentence segmenters for spacy2.0+

meitei-senter

Neural sentence boundary detection for Meitei Mayek (Manipuri) using SentencePiece tokenization and a CNN-based spaCy pipeline.

khmerpunctuate

Punctuation Restoration for Khmer language

py-hasami

A tool to perform sentence segmentation on Japanese text

syntaxcomp

A Python3 package for extracting syntactic complexity measures from CoNLL-U annotations.

wtpsplit-triton

Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.