Etl Framework Python Packages

sf-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

apache-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

sf-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

flowerpower

Simple Workflow Framework based on Hamilton

sf-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

amsdal-glue-connections

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

fluvo

High Performance data Synchronization and transformation platform for odoo, Import, Export, and migration tooling; the modern successor to odoo_csv_import.

dotflow

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

amsdal-glue-core

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

lakehouse-plumber

The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines

sf-hamilton-lsp

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

omniload

omniload is a polyglot data loader based on dlt. Copy data between any source and any destination.

amsdal-glue

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

butterfree

A tool for building feature stores.

canonada

Canonada is a data science framework that helps you build production-ready streaming pipelines for data processing in Python

kgtk

Knowledge Graph Toolkit

vector-etl

Lightweight ETL Framework for Vector Databases

sqlbucket

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

dataforge-core

Command line compiler for dataforge core projects

amsdal-glue-sql-parser

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

sf-hamilton-contrib

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

datacoolie

Metadata-driven ETL framework for portable data pipelines across Polars, Spark, Fabric, Databricks, and AWS.

cratedb-fivetran-destination

CrateDB Fivetran Destination