Corpus Python Packages

speach

🐍🍑 Python 3 library for managing, annotating, and converting natural language corpuses using popular formats (CoNLL, ELAN, Praat, CSV, JSON, SQLite, VTT, Audacity, TTL, TIG, ISF, etc.)

fundus

A very simple news crawler with a funny name

chatterbot-corpus

A multilingual dialog corpus

german-nouns

A list of ~100,000 German nouns and their grammatical properties compiled from WiktionaryDE as CSV file. Plus a module to look up the data and parse compound words.

ms3

A parser for annotated MuseScore 3 files.

corpus-replicator

A corpus generation tool

korpora

This package provides easy-download and easy-usage for various Korean corpora.

expanda

Integrated Corpus-Building Environment

krwordrank

Korean corpus repository

aovec

Make Word2Vec from aozorabunko/aozorabunko

sadedegel

A General Purpose NLP library for Turkish

neosca

Another syntactic complexity analyzer of written English language samples

maalfrid-toolkit

Toolkit for the Målfrid project

ekorpkit

ekorpkit: NLP Library for Social Science Research

rnc

API for Russian National Corpus

opus-api

OPUS (opus.nlpl.eu) Python API

demeuk

Demeuk is a simple tool to clean up corpora (like dictionaries) or any dataset containing plain text strings.

keywords

This is a simple library for extracting keywords from data with/without using a corpus.

pyclue

Python toolkit for Chinese Language Understanding(CLUE) Evaluation benchmark

efaqa-corpus-zh

❤️Emotional First Aid Dataset, 心理咨询问答、聊天机器人语料库

textdirectory

TextDirectory allows you to combine multiple text files into one. While doing this, filters and transformations can be applied.

texttaglib

Python library for managing and annotating text corpuses in different formats (ELAN, TIG, TTL, et cetera)

insuranceqa-data

:helicopter: 保险行业语料库，聊天机器人

npvcc2016

Python loader of npVCC2016 corpus