Chinese Word Segmentation Python Packages

symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

pkuseg

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

pyhanlp

中文分词

microtokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

pywordseg

Open source state-of-the-art Chinese word segmentation toolkit

ner-kit

A toolkit for simple NLP APIs based on Stanza

cjieba

Python cffi binding to CppJieba

jiagu

Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类

g2pc

g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese

monpa

MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

handict

Yet another word segmentation tool.

yyhanlp

中文分词

trad-zh-search

trad-zh-search 可單獨搭配主流搜尋引擎，專門給繁體中文使用的繁體中文文本預處理工具 —— CKIP 分詞 + bigram 索引生成，附可選擇的領域字典系統

simjb

A simple version of jieba.