PyRank

Etl Pipeline Python Packages

Python packages with the GitHub topic etl-pipeline. Sorted by relevance, with stars and monthly downloads.
apache
sf-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

170K 3K 198
apache
apache-hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

73K 3K 198
souvik-databricks
dlt-with-debug

A lightweight helper utility which allows developers to do interactive pipeline development by having a unified source code for both DLT run and Non-DLT interactive notebook run.

19K 50 8
dagworks-inc
sf-hamilton-sdk

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

13K 3K 198
dagworks-inc
sf-hamilton-ui

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

9K 3K 198
ebonnal
streamable

sync/async iterable streams for Python

8K 321 6
cgoldberg
talend-task

CLI and Python API for running Talend Cloud jobs

6K 1 0
Breaka84
spooq

Spooq is a PySpark based helper library for ETL data ingestion pipeline in Data Lakes.

4K 10 2
getfluvo
fluvo

High Performance data Synchronization and transformation platform for odoo, Import, Export, and migration tooling; the modern successor to odoo_csv_import.

4K 4 2
dotflow-io
dotflow

🎲 Dotflow turns an idea into flow! — Lightweight Python library for execution pipelines

4K 9 8
zebflow
zebflow

Zebflow is an interactive full-stack builder and automation platform for geospatial, AI, and data-intensive applications. It lets teams automate Web GIS development on the fly, combining map servers, SSR, SPA, SSG, Web APIs, and real-time interactions inside an observable Rust backend graph. Deploy once, evolve safely.

3K 1 0
dagworks-inc
sf-hamilton-lsp

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

3K 3K 198
MTSWebServices
onetl

One ETL tool to rule them all

3K 87 8
RADar-AZDelta
rabbit-in-a-blender

An ETL pipeline to transform your EMP data to OMOP.

2K 18 6
Zipstack
unstract-sdk

A framework for writing Unstract Tools/Apps

2K 24 1
badal-io
gcp-airflow-foundations-dev

Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse

2K 15 2
dataplane-app
dataplane

The data engineering library to build robust, reliable and on time data pipelines in Python. Integrates with Dataplane Data Platform.

1K 3 3
RLado
canonada

Canonada is a data science framework that helps you build production-ready streaming pipelines for data processing in Python

1K 1 2
MobileTeleSystems
horizon-hwm-store

Horizon HWM Store for onETL

1K 4 0
ContextData
vector-etl

Lightweight ETL Framework for Vector Databases

1K 108 19
LostMa-ERC
heurist-api

API wrapper and CLI for exporting data from a Heurist database server.

1K 4 0
tabsdata
tabsdata

A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.

996 41 2
BBVA
data-refinery

Data transformation

963 23 3
tabsdata
tabsdata-mongodb

A Pub/Sub for Tables based data integration platform, to discover, publish, modify and consume data effortlessly.

883 41 2