Data Curation Python Packages

fiftyone-db

Refine high-quality datasets and visual AI models

fiftyone

Refine high-quality datasets and visual AI models

cleanlab

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

fastdup

fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.

cleanlab-studio

Client interface for all things Cleanlab Studio

fiftyone-db-ubuntu2204

Refine high-quality datasets and visual AI models

distributed-curator

Partition-aware MinHash LSH deduplication for large-scale text data curation on Apache Spark

selfclean

A holistic self-supervised data cleaning strategy to detect off-topic samples, near duplicates and label errors.

fiftyone-desktop

Refine high-quality datasets and visual AI models

sliceguard

A library for detecting problematic data segments in structured and unstructured data with few lines of code.

synrbl

Rebalancing chemical reaction

cubids

Curation of BIDS (CuBIDS): A sanity-preserving software package for processing BIDS datasets.

cleanlab-cli

Command line interface for all things Cleanlab Studio

fiftyone-db-ubuntu2004

Refine high-quality datasets and visual AI models

example-package-elisno

The standard package for data-centric AI, machine learning with label errors, and automatically finding and fixing dataset issues in Python.

ldcoolp-figshare

Python tool using the Figshare API for data curation

docta-ai

Docta.ai

annotate-ez

High-throughput curation and visualization of large-scale single-cell microscopy images, in a lightweight GUI.

fiftyone-db-debian9

Refine high-quality datasets and visual AI models

invisible-rabbit

Scalable data pre processing and curation toolkit for LLMs

urlgenie

Python package to make URL extraction, generalization, validation, and filtration easy.

fiftyone-db-rhel7

Refine high-quality datasets and visual AI models

fiftyone-db-ubuntu1604

Refine high-quality datasets and visual AI models

cubids-bond-fork

BIDS On Disk Editor