Computational Linguistics Python Packages

pythainlp

Thai natural language processing in Python

pycantonese

Cantonese Linguistics and NLP

rustling

A high-performance library for computational linguistics

botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python

pylangacq

Language Acquisition Research Tools

wordseg

Word segmentation models

arpa

:snake: Python library for n-gram models in ARPA format

pynlpl

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

wikipron

Massively multilingual pronunciation mining

linguaf

python package for calculating famous measures in computational linguistics

python-ucto

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

folia-linguistic-annotation-tool

FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. Flat allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm.

folia

An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic annotation finding application in Natural Language Processing (NLP). This library was formerly part of PyNLPl.

rutextnorm

Fast Russian Text normalization for TTS using only RegEx.

chandassu

Chandassu: First Python Library for Global Metrical Poetry

finntk

Some simple high level tools for processing Finnish text

russian-tts-normalization

Fast Russian Text normalization for TTS using only RegEx.

calamancy

NLP pipelines for Tagalog using spaCy

pybo

🦜 NLP for Tibetan, in Python.

linguistica

Linguistica 5: Unsupervised Learning of Linguistic Structure

morphseg

An efficient and easy-to-use morpheme segmentation library

fonetika

Russian/English/Estonian/Finnish/Swedish phonetic algorithm based on Soundex and Metaphone

bllipparser

BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

glazing

Unified data models and interfaces for syntactic and semantic frame ontologies.