Etl Pipeline Python Packages

sf-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

apache-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

sf-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

etlplus

A Python package and command-line interface for practical ETL operations and workflows

streamable

sync/async iterable streams for Python

zebflow

Zebflow is an interactive full-stack builder and automation platform for geospatial, AI, and data-intensive applications. It lets teams automate Web GIS development on the fly, combining map servers, SSR, SPA, SSG, Web APIs, and real-time interactions inside an observable Rust backend graph. Deploy once, evolve safely.

dlt-with-debug

A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.

sf-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

apache-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

spooq

Spooq is a PySpark based helper library for ETL data ingestion pipeline in Data Lakes.

sf-hamilton-lsp

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

sci-etl-core

Async-first, domain-agnostic Python toolkit for mining scientific literature: LLM-powered ETL pipelines with pluggable extractors, parsers, exporters, and resumable state.

unstract-sdk

A framework for writing Unstract Tools/Apps

onetl

One ETL tool to rule them all

apache-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

rabbit-in-a-blender

An ETL pipeline to transform your EMP data to OMOP.

dotflow

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

gdeltforge

Forges the raw GDELT archive (Events, GKG, Mentions) into clean, reproducibly-sampled, cross-referenced Parquet.

tabsdata

A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.

canonada

Canonada is a data science framework that helps you build production-ready streaming pipelines for data processing in Python

sci-etl-cli

CLI tool for sci-etl-core to search arXiv, parse PDFs, validate configurations, and run asynchronous ETL extraction pipelines.

fluvo

High Performance data Synchronization and transformation platform for odoo, Import, Export, and migration tooling; the modern successor to odoo_csv_import.

gcp-airflow-foundations-dev

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

tabsdata-agent

A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.