Data Integrity Python Packages

datajoint

Relational Workflows: where database schemas define executable data pipelines.

openomicsbench

Traceable omics benchmarks with multi-method matrices, regression gates, portable bundles and sequence tools.

openvc-core

Generic, HSM-friendly Verifiable Credentials core — VC-JWT and Data Integrity proofs, DID resolution (key/web/ebsi), status lists — with an optional read-only EBSI plugin.

codex-preserve

Local-first preservation and integrity verification for persisted coding-agent sessions from Codex, Claude Code, Kimi Code, and ZCode.

reliadl

Production-grade, fault-tolerant parallel file download system with per-chunk SHA-256 cryptographic verification, dynamic retries, and resumable transfers.

raftward

Offline, guarded integrity checks for closed SQLite databases and backups

sqlbucket

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

jevaudit

Independent ledger integrity auditor - reconcile ledger records against independently retrieved on-chain data. Case study: a listener reporting 0-block lag, while independent reconciliation found 5 blocks / 61 missing fills. Reproducible, regression-tested.

tamper-signal

Tamper Signal: signed receipts for vibe-coded data pipelines. Proves nobody changed your data, and shows the exact link if they did.

encypher-ai

Metadata encoding and extraction for AI-generated content

calendar-smith

Lightweight fiscal, ISO week, and timezone utilities for Python. Includes CSV processing, date windows, and safety-first date parsing. Zero dependencies.

session-preserve

Local-first preservation and integrity verification for persisted coding-agent sessions from Codex, Claude Code, Kimi Code, and ZCode.

octopus-ml

A collection of handy ML and data visualization and validation tools. Go ahead and train, evaluate and validate your ML models and data with minimal effort.

dazzle-preserve

Preserve is a lightweight cross-platform file "preservation" tool that maintains directory structure during file transfers. Includes path normalization (relative/absolute/flat), SHA256 verification, metadata retention, and bidirectional operations. Perfect for archiving, backups, and transferring files while maintaining their original organization.

chkbit

Check your files for data corruption and run quick file deduplication

irotechlab-irodb

A lightweight, file-based database engine for Python with SHA-256 hashing, ACID transactions.

dynamicfeed-verify

Fluxdyne Verify — open-source verifier for Ed25519-signed AI evidence receipts. Reference implementations in Python, JavaScript/TypeScript and Rust, with signing-key lifecycle policy.

aldertech-asg

Aldertech Storage Governor — Intelligent health monitoring, capacity planning, and scrub scheduling for BTRFS RAID pools with mismatched drives.

fancy-sa-filemodel

A sqlalchemy extension to store files to various storage and maintain the file integrity.

janus-validation

Janus is a Python library designed for robust data validation, serialization, and schema versioning. It offers a comprehensive toolkit to handle input validation, data transformation, and API schema evolution, making it ideal for modern Python applications that require data integrity and compatibility.

dynamicfeed-tools

Fluxdyne Verify — open-source verifier for Ed25519-signed AI evidence receipts. Reference implementations in Python, JavaScript/TypeScript and Rust, with signing-key lifecycle policy.

sisu-wrapper

A constraint-aware decision-support system for Aalto course planning, designed around deterministic ranking and explicit scheduling trade-offs

vaultxfer

Secure SSH-based CLI file transfer & bidirectional sync tool with atomic operations and integrity verification.

rotbyte

Detect silent data corruption (bit rot) with BLAKE2b checksums — cross-platform, zero dependencies, with built-in scheduling and email alerts.