Text Segmentation Python Packages

symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

catalyst

Accelerated deep learning R&D

ekphrasis

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

harvesttext

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

fast-sentence-segment

Fast and Efficient Sentence Segmentation

charstreamer

Rust and Python toolkit for high-throughput model-backed text segmentation and semantic-structure annotation.

qikou

Cadence (气口 / qikou) — 语义感知的聊天气泡切分器：把 AI 的长回复切成读起来像真人发出的短消息。纯 Python 标准库，零第三方依赖。

morphseg

An efficient and easy-to-use morpheme segmentation library

pawpaw

Text Processing & Segmentation Framework

deepsegment

A sentence segmenter that actually works!

chunkseg

Evaluate chaptering quality for audio and video content in time space, supporting segmentation and title generation

symspellcpppy

Fast SymSpell written in c++ and exposes to python via pybind11

furrow

lightweight, zero-dependency Python algorithm and state-machine to clean up, segment, and format structured question chains from messy OCR, handwriting text dumps, transcripts, and LLM outputs.

lingpatlab

LingPatLab: Linguistic Pattern Laboratory

tokenizesentences

Tiny, dependency-free English sentence tokenizer.

typeseg

Content-Type Segmentation for Mixed Text

mschunker

Smart text chunker for LLM preprocessing (sections → paragraphs → sentences → hard splits).

tajik-text-segmentation

Tajik text segmentation algorithms

catalyst-pdm

Accelerated deep learning R&D