Data Curation Python Packages

fiftyone-db

Refine high-quality datasets and visual AI models

fiftyone

Refine high-quality datasets and visual AI models

cleanlab

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

lsst-rucio-register

Routines and commands to add Butler specific information to Rucio metadata

bids-manager

GUI and CLI tool for raw-to-BIDS conversion, curation, metadata editing, and validation for MRI, EEG, MEG, and physiological recordings.

fastdup

fastdup is a powerful, free tool designed to rapidly generate valuable insights from image and video datasets. It helps enhance the quality of both images and labels, while significantly reducing data operation costs, all with unmatched scalability.

cleanlab-studio

Client interface to Cleanlab Studio

weightslab

Monitoring platform for ML teams building real‑world AI at scale.

fiftyone-db-ubuntu2204

Refine high-quality datasets and visual AI models

fiftyone-desktop

Refine high-quality datasets and visual AI models

selfclean

[NeurIPS 2024] 🧼🔎 A holistic self-supervised data cleaning strategy to detect irrelevant samples, near duplicates and label errors.

sliceguard

A library for detecting problematic data segments in structured and unstructured data with few lines of code.

synrbl

Rebalancing chemical reaction

cubids

Curation of BIDS (CuBIDS): A sanity-preserving software package for processing BIDS datasets.

urlgenie

Python package to make URL extraction, generalization, validation, and filtration easy.

cleanlab-cli

Client interface to Cleanlab Studio

ldcoolp-figshare

Python tool using the Figshare API for data curation

chamanp

CHAMANP is a modular, extensible, and production-grade system for the curated preparation of molecular databases.

example-package-elisno

Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

distributed-curator

Partition-aware MinHash LSH deduplication library for large-scale text data curation on Apache Spark.

fiftyone-db-debian9

Refine high-quality datasets and visual AI models

tmtk

tranSMART Arborist ETL toolkit

invisible-rabbit

Scalable data pre processing and curation toolkit for LLMs

docta-ai

A Doctor for your data