Computational Linguistics Python Packages

pythainlp

Thai natural language processing in Python

pycantonese

Cantonese Linguistics and NLP

rustling

A high-performance library for computational linguistics

botok

🏷 བོད་ཏོག [pʰøtɔk̚] Tibetan word tokenizer in Python

rutextnorm

Fast Russian Text normalization for TTS using only RegEx.

pylangacq

Language Acquisition Research Tools

radixor-c

A multilingual stemming engine by Egothor.

wordseg

Word segmentation models

anyts

Any Texts Statistics: the language-independent core of ruTS and esTS - lexical diversity, cohesion and syntax helpers, corpus measures and stylometry

arpa

:snake: Python library for n-gram models in ARPA format

ruts

Библиотека для извлечения статистик из текстов на русском языке.

python-ucto

This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet it is not always as trivial a task as it appears to be. This binding makes the power of the ucto tokeniser available to Python. Ucto itself is regular-expression based, extensible, and advanced tokeniser written in C++ (http://ilk.uvt.nl/ucto).

pynlpl

PyNLPl, pronounced as 'pineapple', is a Python library for Natural Language Processing. It contains various modules useful for common, and less common, NLP tasks. PyNLPl can be used for basic tasks such as the extraction of n-grams and frequency lists, and to build simple language model. There are also more complex data types and algorithms. Moreover, there are parsers for file formats common in NLP (e.g. FoLiA/Giza/Moses/ARPA/Timbl/CQL). There are also clients to interface with various NLP specific servers. PyNLPl most notably features a very extensive library for working with FoLiA XML (Format for Linguistic Annotation).

linguaf

python package for calculating famous measures in computational linguistics

pyests

Spanish Texts Statistics: readability, lexical diversity, morphology, syntax, cohesion, stylometry, metre and rhyme for Spanish text

treesearch-ud

High-performance toolkit for querying linguistic dependency parses

wikipron

Massively multilingual pronunciation mining

pydmrs

A library for manipulating DMRS structures

radixor

A multilingual stemming engine by Egothor.

folia

An extensive Python library for dealing with FoLiA (Format for Linguistic Annotation) documents, a rich XML-based format for linguistic annotation finding application in Natural Language Processing (NLP). This library was formerly part of PyNLPl.

chandassu

Chandassu: First Python Library for Global Metrical Poetry

finntk

Some simple high level tools for processing Finnish text

folia-linguistic-annotation-tool

FoLiA Linguistic Annotation Tool -- Flat is a web-based linguistic annotation environment based around the FoLiA format (http://proycon.github.io/folia), a rich XML-based format for linguistic annotation. Flat allows users to view annotated FoLiA documents and enrich these documents with new annotations, a wide variety of linguistic annotation types is supported through the FoLiA paradigm.

pybo

🦜 NLP for Tibetan, in Python.