Data Quality Checks Python Packages

openmetadata-ingestion

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

traceml

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

datatile

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

pandas-summary

Engine for AI/ML/Data tracking, visualization, explainability, drift detection, and dashboards for Polyaxon.

cuallee

Possibly the fastest DataFrame-agnostic quality check library in town.

openmetadata-managed-apis

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

re-data

re_data - fix data issues before your users & CEO would discover them 😊

openmetadata-ingestion-core

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

sumeh

Sumeh — Unified Data Quality Framework Sumeh is a unified data quality validation framework supporting multiple backends (PySpark, Dask, Polars, DuckDB, Pandas) with centralized rule configuration.

dqops

Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observability. Configure data quality checks from the UI or in YAML files, let DQOps run the data quality checks daily to detect data quality issues.

sqlbucket

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

data-watchtower

数据质量检查工具, 用于诊断数据的问题

forge-robotics

Robotics Data Toolkit | Convert between robotics dataset formats (RLDS, LeRobot v2/v3, Zarr, HDF5, Rosbag). Inspect, visualize, and analyze datasets. Works with HuggingFace Hub. Built for OpenVLA, Octo, LeRobot, and Diffusion Policy workflows.

openmetadata-airflow-managed-apis

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

redflag

Safety net for machine learning pipelines. Plays nice with sklearn and pandas.

grib-check

A tool that validates project-specific conventions of GRIB files

reqdonkey

The Requirements Donkey: deterministic auditing of whether code honors its implied, documented, and specified requirements. Computes the PPI (Polysemy Preservation Index). Local, zero-exfiltration -- your code never leaves; only the verdict does.

dqc-toolkit

Data Quality Check for Machine Learning

weiser-ai

Data Quality made simple.

dbt-dqlens

Data quality for dbt, without writing tests. Auto-generates dbt tests by profiling your database.

etlx-wrapper

ETL / ELT / Reverse ETL Framework powered by DuckDB, designed to seamlessly integrate and process data from diverse sources. It leverages Markdown as a configuration medium, where YAML blocks define metadata for each data source, and embedded SQL blocks specify the extraction, transformation, and loading logic.

openmetadata-sqlalchemy-bigquery

SQLAlchemy dialect for BigQuery by OpenMetadata

validatelite

A flexible, extensible command-line tool for automated data quality validation

qprofiler

profile tabular datasets, manage automatic validation for new datasets, automatic handling for quality issues.