PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Etl Framework Python Packages

Python packages with the GitHub topic etl-framework. Sorted by monthly downloads, with stars and forks.
apache
sf-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

209K 3K 220
apache
apache-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

141K 3K 220
pathwaycom
pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

25K 62K 2K
apache
sf-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

12K 3K 220
legout
flowerpower

Simple Workflow Framework based on Hamilton

10K 25 1
Dagitali
etlplus

A Python package and command-line interface for practical ETL operations and workflows

9K 4 0
apache
sf-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

7K 3K 220
emiliano-go
rypipe

Format- and source-agnostic ingestion framework: a common execution runtime for turning record-oriented data sources into typed columnar data. Rust core, Python bindings; adapters live in separate packages.

6K 23 2
amsdal
amsdal-glue-connections

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

4K 4 0
apache
apache-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

4K 3K 220
apache
sf-hamilton-lsp

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

3K 3K 220
Mmodarre
lakehouse-plumber

The Metadata Driven framework for Databricks Lakeflow Declarative Pipelines (formerly Delta Live Tables). Metadata framework that generates production ready Pyspark code for Lakeflow Declarative Pipelines

3K 67 14
apache
apache-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

2K 3K 220
panodata
omniload

omniload is a polyglot data loader based on dlt. Copy data between any source and any destination.

2K 5 4
amsdal
amsdal-glue-core

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

2K 4 0
dotflow-io
dotflow

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

2K 10 8
quintoandar
butterfree

A tool for building feature stores.

2K 319 38
amsdal
amsdal-glue

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

1K 4 0
RLado
canonada

Canonada is a data science framework that helps you build production-ready streaming pipelines for data processing in Python

1K 2 2
getfluvo
fluvo

High Performance data Synchronization and transformation platform for odoo, Import, Export, and migration tooling; the modern successor to odoo_csv_import.

1K 5 3
panodata
dlt-filesystem

omniload is a polyglot data loader based on dlt. Copy data between any source and any destination.

1K 5 4
socialpoint-labs
sqlbucket

Lightweight library to write, orchestrate and test your SQL ETL. Writing ETL with data integrity in mind.

1K 74 8
usc-isi-i2
kgtk

Knowledge Graph Toolkit

781 425 62
amsdal
amsdal-glue-sql-parser

A Python library for querying multiple databases simultaneously through a unified interface, enabling data virtualization without moving data.

727 4 0
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology