Text Segmentation Python Packages

symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

catalyst

Accelerated deep learning R&D

fast-sentence-segment

Fast and Efficient Sentence Segmentation

harvesttext

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键词抽取、知识抽取、句法分析等），无监督或弱监督方法

ekphrasis

Ekphrasis is a text processing tool, geared towards text from social networks, such as Twitter or Facebook. Ekphrasis performs tokenization, word normalization, word segmentation (for splitting hashtags) and spell correction, using word statistics from 2 big corpora (english Wikipedia, twitter - 330mil english tweets).

furrow

lightweight, zero-dependency Python algorithm and state-machine to clean up, segment, and format structured question chains from messy OCR, handwriting text dumps, transcripts, and LLM outputs.

morphseg

An efficient and easy-to-use morpheme segmentation library

deepsegment

A sentence segmenter that actually works!

chunkseg

Evaluate chaptering quality for audio and video content in time space, supporting segmentation and title generation

tajik-text-segmentation

Tajik text segmentation algorithms

symspellcpppy

A Fast SymSpell port for python written in C++ using pybind11.

pawpaw

Text Processing & Segmentation Framework

lingpatlab

LingPatLab: Linguistic Pattern Laboratory

mschunker

Smart text chunker for LLM preprocessing (sections → paragraphs → sentences → hard splits).

catalyst-pdm

Catalyst fork compatible with PDM

testmorphseg

Erm... What the Segma?