Crowdsourcing Python Packages

weblate

Web based localization tool with tight version control integration.

crowd-kit

Control the quality of your labeled data with the Python tools you already know.

toloka-kit

Toloka-Kit is a Python library for working with Toloka API.

wq

A modular framework for mobile surveys and field data collection via offline-capable mobile web apps.

crowdnalysis

Library to help analyze crowdsourcing results

crowdtruth

CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems

weblate-a1az

A web-based continuous localization system with tight version control integration

crowdtruth-fork

CrowdTruth framework for crowdsourcing ground truth for training & evaluation of AI systems

weblate-em0t

Web based localization tool with tight version control integration.

turkle

Django-based clone of Amazon's Mechanical Turk service

crowded

🤖 Guideline for designing optimal crowdsourcing experiments

slopit

Tools for detecting the use of AI assistance in crowd-sourced data collection

garner

A library for interacting with the Garner API.