Data Lineage Python Packages

sqllineage

SQL Lineage Analysis Tool powered by Python

elementary-data

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

openmetadata-ingestion

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

lamindb

Open-source data management for multimodal AI. Query, trace, and govern with a lineage-native, format-agnostic lakehouse for agents and teams. Supports biological formats and registries - by the creators of Scanpy. 🍊YC S22

lamindb-core

Open-source data management for multimodal AI. Query, trace, and govern with a lineage-native, format-agnostic lakehouse for agents and teams. Supports biological formats and registries - by the creators of Scanpy. 🍊YC S22

openmetadata-managed-apis

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

datajoint

Relational Workflows: where database schemas define executable data pipelines.

quickstart-vdk

⛔ [ARCHIVING ON 2026-11-01] One framework to develop, deploy and operate data workflows with Python and SQL.

isnad

Grade every agent, scraper and model in a claim's chain — provenance, trust scoring and audit evidence for LLM pipelines

dagster-rocky

A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.

convalesce-emit

Client libraries that forward a data tool's own output to Convalesce, unchanged.

plumb-line-provenance

Stop uncertain data becoming confident-looking results. plumb-line carries provenance, confidence and mock-taint with values through JavaScript and Python, and its review-time checks and GitHub Action catch uncertainty laundered into a claim in AI-assisted code.

rocky-sdk

A SQL transformation engine that type-checks your whole pipeline and catches breaking changes before they run — branches, replay, column-level lineage, compile-time contracts, per-model cost. Adapters: Databricks, Snowflake, BigQuery, DuckDB. Single static Rust binary. Apache 2.0.

whodb-sdk

Where data access meets operational intelligence

pandas-blame

Cell-level why for pandas pipelines. No code changes.

qedro

Turns emitted evidence into the artefacts an auditor asks for. Reads OpenLineage, produces a GDPR Art. 30 record of processing activities.

driftdb

Metrics Observability & Troubleshooting

clew-lineage

Lineage-based impact analysis and remediation for workflow runs. What a bad input or an incident report reached, what to re-run, delete or disclose, sealed as evidence an auditor verifies offline. Incident triage, MCP tools for agents, agent-written providers. Reads Nextflow, Snakemake, Cromwell, Horus, DNAnexus and Latch.

cascade-ml

Small-scale MLOps library

pydtsx-parser

Parse SQL Server Integration Services (SSIS) .dtsx, .dtproj, .conmgr and .params files into structured JSON

upstrace

Trace a failed data quality check upstream to the change that caused it. Column-level drift detection and LLM root-cause analysis for dbt projects.

grai-schemas

No description available

grai-client

No description available

fineprint

Read the fine print of your metrics — a decompiler for your dashboards. Column-level lineage, provable metric formulas, and drift detection, built entirely from dbt artifacts (no warehouse connection).