Chinese Nlp Python Packages

argus-redact

Encrypt PII, not meaning. Locally.

rouge-chinese

Python ROUGE Score Implementation for Chinese Language Task (official rouge score)

adaseq

AdaSeq: An All-in-One Library for Developing State-of-the-Art Sequence Understanding Models

airllm

AirLLM 70B inference with single 4GB GPU

ltp-extension

Language Technology Platform

jiojio

A convenient Chinese word segmentation tool 简便中文分词器

ltp

Language Technology Platform

ltp-core

Language Technology Platform

microtokenizer

A micro tokenizer for Chinese

plane

A text processing tool including tag(HTML, URL, Email) extraction and removing, punctuation normalization, simple segmentation, and so on.

pyltp

pyltp: the python extension for LTP

thulac

An Efficient Lexical Analyzer for Chinese

distilbert-punctuator

A small seq2seq punctuator tool based on DistilBERT

memexa

Self-hosted Chinese personal memory graph. Six sources, two LLMs, one graph.

lac

百度NLP：分词，词性标注，命名实体识别，词重要性

easy-zh-bert

easy-bert是一个中文NLP工具，提供诸多bert变体调用和调参方法，极速上手；清晰的设计和代码注释，也很适合学习

pnlp

NLP预/后处理工具。

fancy-nlp

NLP for human. A fast and easy-to-use natural language processing (NLP) toolkit, satisfying your imagination about NLP.

hanlperceptron

Native Python HanLP Perceptron Model: HanLPerceptron 中文斷詞 詞性標註 命名實體識別

hnlp

NLP预/后处理工具。

synth-wiki

LLM-wiki: drop in papers/articles/notes, get a structured, interlinked, searchable wiki knowledge base. LLM-wiki：扔论文、丢笔记，自动生成交互链接、可搜索的个人wiki知识库。

muldichinese

A Chinese register analyser.

chop

Chinese Words Segementation Utilities

envtext

中文环境领域文本分析包，纯神经网络架构，支持EnvBert,LSTM,RNN,word2vec等模型，支持自定义模型，下游任务包括分类，回归，多选，情感分析，命名实体识别等，专题包括气候变化文本分析，环境知识图谱等。针对领域研究进行了接口的优化，一键使用模型。