Datapipeline Python Packages

mustrd

MustRD: Validate your SPARQL queries and transformations with precision and confidence, using BDD and Given-When-Then principles

yaml-workflow

A lightweight, powerful, and flexible workflow engine that executes tasks defined in YAML configuration files.

kedro-static-viz

kedro cli plugin for generating a static kedro viz site (html, css, js) that can be deployed on many serverless tools.

statguardian

Fast, declarative data quality framework (Rust). Schema validation, drift detection, anomaly detection. Pandas/Polars/DuckDB support.

aksdp

A simple framework for writing data pipelines in Python

vector-etl

Build super simple end-to-end data & ETL pipelines for your vector databases and Generative AI applications

smart-pipeline

Process any type of data in your projects easily, control the flow of your data.

stitched

A Python-based data tool for Integrating Hate Speech datasets with varying schemas.