PyRank

Multilingual Nlp Python Packages

Python packages with the GitHub topic multilingual-nlp. Sorted by monthly downloads, with stars and forks.
embeddings-benchmark
mteb

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

698K 3K 719
leogalambos
radixor-c

A multilingual stemming engine by Egothor.

8K 1 0
leogalambos
radixor

A multilingual stemming engine by Egothor.

2K 1 0
leogalambos
radixor-models-standard

A multilingual stemming engine by Egothor.

726 1 0
stighellemans
meddeid

Local-first multilingual clinical text de-identification framework with Dutch and English models, pluggable language profiles, and Python, CLI, batch, and HTTP interfaces.

651 2 0
AI4Code-Research
codetext

[EMNLP 2023] The Vault: A Comprehensive Multilingual Dataset for Advancing Code Understanding and Generation

387 105 10
oyinkanchekwas
low-resource-nlp-toolkit

Selective language routing and code-switch audits, evaluated on a reproducible AfriSenti benchmark.

195 0 0
posi-olomo
padie-extended

An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.

179 28 4
techwolf-ai
workrb

WorkRB: Work Research Benchmark

174 42 8
dkalpakchi
quinductor

A multilingual data-driven method for generating reading comprehension questions

116 1 1
omarkamali
vocabulous

Bootstrapping Language Detection from Noisy & Ambiguous Data

78 2 0