Crowdsourcing Python Packages

weblate

Web based localization tool with tight version control integration.

crowd-kit

Control the quality of your labeled data with the Python tools you already know.

toloka-kit

Toloka-Kit is a Python library for working with Toloka API.

wq

A modular framework for mobile surveys and field data collection via offline-capable mobile web apps.

crowdnalysis

Library to help analyze crowdsourcing results

crowdtruth

Disagreement based metrics for the processing and evaluation of crowdsourced annotations

weblate-a1az

Web based localization tool with tight version control integration.

weblate-em0t

Web based localization tool with tight version control integration.

garner

A library for interacting with the Garner API.

turkle

Django-based clone of Amazon's Mechanical Turk service running in your local environment.

crowded

This package contains the methods to generate simulated workers and tasks of a crowdsourcing use case

crowdtruth-fork

Disagreement based metrics for the processing and evaluation of crowdsourced annotations

slopit

Tools for detecting the use of AI assistance in crowd-sourced data collection