Chinese Word Segmentation Python Packages

symspellpy

Python port of SymSpell: 1 million times faster spelling correction & fuzzy search through Symmetric Delete spelling correction algorithm

pkuseg

pkuseg多领域中文分词工具; The pkuseg toolkit for multi-domain Chinese word segmentation

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

microtokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

pyhanlp

中文分词

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

cjieba

Python cffi binding to CppJieba

pywordseg

Open Source State-of-the-art Chinese Word Segmentation System with BiLSTM and ELMo. https://arxiv.org/abs/1901.05816

ner-kit

A toolkit for simple NLP APIs based on Stanza

jiagu

Jiagu深度学习自然语言处理工具 知识图谱关系抽取 中文分词 词性标注 命名实体识别 情感分析 新词发现 关键词 文本摘要 文本聚类

g2pc

g2pC: A Context-aware Grapheme-to-Phoneme Conversion module for Chinese

handict

Yet another word segmentation tool.

monpa

MONPA 罔拍是一個提供正體中文斷詞、詞性標註以及命名實體辨識的多任務模型

trad-zh-search

trad-zh-search 可單獨搭配主流搜尋引擎，專門給繁體中文使用的繁體中文文本預處理工具 —— CKIP 分詞 + bigram 索引生成，附可選擇的領域字典系統

simjb

✂️用 100 行实现简单版本的 jieba 分词

yyhanlp

中文分词