Low Resource Languages Python Packages

ne-agent

Terminal AI agent for Northeast India's low-resource languages. Local, offline, multilingual routing (search, translate, transcribe).

4K 0 0

pyidaungsu-numpy2

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.

4K 41 7

everyvoice

The EveryVoice TTS Toolkit - Text To Speech for your language

2K 43 4

pyidaungsu

Tiny language detector + tokenizer for 50+ SE/South Asian languages (Burmese, Karen, Chin, Shan, Mon, Khmer, Lao, Thai, Tamil, Hindi, …). Revamp of pyidaungsu.

1K 41 7

chandassu

Chandassu: First Python Library for Global Metrical Poetry

1K 15 1

calamancy

NLP pipelines for Tagalog using spaCy

1K 71 6

amharic-tokenizer

Amharic tokenizer with BPE-like merges over decomposed fidel (Cython)

806 100 15

ne-embed

Multilingual sentence embeddings for 10 Northeast Indian languages

741 0 0

ricelang

Language identification and tokenization for Southeast Asian languages (Burmese, Karen variants, Chin variants, Eastern Kayah, Shan, etc.) — also exposes a `ricelang` CLI

570 41 7

padie-extended

An open-source Python package that uses AI to predict Nigerian languages, including English, Pidgin, Yoruba, Hausa, and Igbo.

392 28 4

meitei-senter

Neural sentence boundary detection for Meitei Mayek (Manipuri) using SentencePiece tokenization and a CNN-based spaCy pipeline.

333 0 0

annaparavai

AI-generated vs Human-written text detector for Tamil and Malayalam languages

200 0 1

kkltk

The Kinyarwanda and Kirundi Languages Toolkit (KKLTK) is a Python package for Kinyarwanda and Kirundi languages processing. KKLTK currently provides the sets of stopwords for both languages and other preprocessing tools such as Kinyarwanda and Kirundi tokenizers will be added soon. KKLTK requires Python 3.0, 3.5, 3.6, 3.7, or 3.8.

115 1 2

tratreetra

simple syntactic transfer based on the treebank translation

103 0 0