Corpus Python Packages

speach

🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, JSON, SQLite, VTT, Audacity, TTL, TIG, ISF, etc.)

willow-corpus-lens

Local-first process lens for your own human+agent corpus.

german-nouns

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

chatterbot-corpus

A multilingual dialog corpus

ms3

A parser for annotated MuseScore 3 files.

corpus-replicator

A corpus generation tool

ef

Embeddings Flow -- Tools for workflows involving semantic embeddings

fundus

A very simple news crawler with a funny name

korpora

Korean corpus repository

sadedegel

A General Purpose NLP library for Turkish

expanda

The universal integrated corpus-building environment.

neosca

L2SCA & LCA fork: cross-platform, GUI, without Java dependency

ekorpkit

ekorpkit: NLP Library for Social Science Research

keywords

This is a simple library for extracting keywords from data with/without using a corpus.

aovec

Easy aozorabunko Word2Vec Builder - 青空文庫全書籍のWord2Vecビルダー+構築済みモデル

demeuk

Demeuk is a simple tool to clean up corpora (like dictionaries) or any dataset containing plain text strings.

maalfrid-toolkit

Toolkit for the Målfrid project

rnc

API for Russian National Corpus

opus-api

OPUS (opus.nlpl.eu) Python3 API

krwordrank

Korean corpus repository

humor-mcp

MCP server over a local humor corpus that credits every line it returns

ua-gec

UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language

textdirectory

TextDirectory allows you to filter, transform, and combine multiple text files into one aggregated file.

pyclue

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark