Chinese Nlp Python Packages

argus-redact

Encrypt PII, not meaning. Locally.

60K 12 1

rouge-chinese

Python ROUGE Score Implementation for Chinese Language Task (official rouge score)

58K 115 4

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

30K 452 43

airllm

AirLLM 70B inference with single 4GB GPU

7K 36K 4K

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

6K 49 8

ltp-extension

Language Technology Platform

4K 5K 1K

ltp

Language Technology Platform

3K 5K 1K

microtokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

2K 159 22

thulac

An Efficient Lexical Analyzer for Chinese

2K 2K 331

ltp-core

Language Technology Platform

2K 5K 1K

ruhui

Multilingual, non-autoregressive System 1 decision model.

1K 1 0

pyltp

pyltp: the python extension for LTP

1K 2K 345

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

1K 4K 592

helan

Chinese PII detection, masking, and reversible redaction for Python, LLM, and RAG pipelines.

740 1 0

gewita

Parse Chinese academic references, align quotations to source text, and verify bibliography records.

725 1 0

worddael

Chinese-aware RAG text chunking with exact source offsets, Markdown structure, and LangChain integration.

685 1 0

qikou

Cadence (气口 / qikou) — 语义感知的聊天气泡切分器：把 AI 的长回复切成读起来像真人发出的短消息。纯 Python 标准库，零第三方依赖。

628 0 0

plane

A text processing tool including tag(HTML, URL, Email) extraction and removing, punctuation normalization, simple segmentation, and so on.

574 11 2

jevspan

Zero-shot named entity recognition on TypeSafe Jev. Define entity types in plain words — no training data, no GPU. 73.7 strict F1 across 12 Chinese/English NER benchmarks, with calibrated scores and auditable traces. 零样本命名实体识别。

464 7 1