Corpus Python Packages

speach

🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, JSON, SQLite, VTT, Audacity, TTL, TIG, ISF, etc.)

chatterbot-corpus

A multilingual dialog corpus

german-nouns

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

korpora

Korean corpus repository

ef

Embeddings Flow -- Tools for workflows involving semantic embeddings

fundus

A very simple news crawler with a funny name

corpus-replicator

A corpus generation tool

ms3

A parser for annotated MuseScore 3 files.

krwordrank

Korean corpus repository

ekorpkit

ekorpkit: NLP Library for Social Science Research

efaqa-corpus-zh

Emotional First Aid Dataset, 心理咨询问答语料库

maalfrid-toolkit

Toolkit for the Målfrid project

expanda

Integrated Corpus-Building Environment

neosca

L2SCA & LCA fork: cross-platform, GUI, without Java dependency

aovec

Easy aozorabunko Word2Vec Builder - 青空文庫全書籍のWord2Vecビルダー+構築済みモデル

demeuk

CLI tool to remove invalid chars from a corpus.

sadedegel

Extraction-based Turkish news summarizer.

textdirectory

TextDirectory allows you to combine multiple text files into one. While doing this, filters and transformations can be applied.

insuranceqa-data

Insuranceqa Corpus in Chinese for Machine Learning

corpus-similarity

Measure the similarity of text corpora for 74 languages

efaqa-corpus-raw

Emotional First Aid Raw Dataset, 心理咨询问答原始语料库

rnc

API for Russian National Corpus

texttaglib

Python library for managing and annotating text corpuses in different formats (ELAN, TIG, TTL, et cetera)

keywords

This is a simple library for extracting keywords from data with/without using a corpus.