Chinese Nlp Python Packages

argus-redact

Encrypt PII, not meaning. Locally.

rouge-chinese

Python ROUGE Score Implementation for Chinese Language Task (official rouge score)

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

airllm

AirLLM 70B inference with single 4GB GPU

ltp-extension

Language Technology Platform

ltp

Language Technology Platform

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

ltp-core

Language Technology Platform

plane

A text processing tool including tag(HTML, URL, Email) extraction and removing, punctuation normalization, simple segmentation, and so on.

microtokenizer

一个轻量且功能全面的中文分词器，帮助学生了解分词器的工作原理。MicroTokenizer: A lightweight Chinese tokenizer designed for educational and research purposes. Provides a practical, hands-on approach to understanding NLP concepts, featuring multiple tokenization algorithms and customizable models. Ideal for students, researchers, and NLP enthusiasts..

thulac

An Efficient Lexical Analyzer for Chinese

distilbert-punctuator

A small seq2seq punctuator tool based on DistilBERT

pnlp

NLP预/后处理工具。

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

easy-zh-bert

easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习

pyltp

pyltp: the python extension for LTP

fancy-nlp

NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.

hanlperceptron

Native Python HanLP Perceptron Model: HanLPerceptron 中文斷詞 詞性標註 命名實體識別

memexa

Self-hosted Chinese personal memory graph. Six sources, two LLMs, one graph.

envtext

中文环境领域文本分析包，纯神经网络架构，支持EnvBert,LSTM,RNN,word2vec等模型，支持自定义模型，下游任务包括分类，回归，多选，情感分析，命名实体识别等，专题包括气候变化文本分析，环境知识图谱等。针对领域研究进行了接口的优化，一键使用模型。

hnlp

NLP预/后处理工具。

ddparser

百度开源的依存句法分析系统

vault-engine

Identity de-identification for cloud-LLM hand-off: local detection, consistent pseudonyms, a reversible local map, and a swappable model backend.

muldichinese

An open-source library in Python for analysing Chinese registers