Data Pipeline Python Packages

flupy

Fluent data pipelines for python and your shell

1.4M 195 15

elementary-data

The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.

1.3M 2K 217

doit

CLI task management & automation tool

743K 2K 190

airbyte-source-declarative-manifest

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

324K 21K 5K

gusty

Making DAG construction easier

52K 285 13

xorq

Composable expressions for data

52K 510 27

ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

51K 3K 119

airbyte-source-facebook-marketing

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

23K 21K 5K

airbyte-source-google-ads

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

20K 21K 5K

airbyte-source-s3

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

19K 21K 5K

airbyte-source-salesforce

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

16K 21K 5K

dagster-rocky

Rust SQL transformation engine with branches, replay, column-level lineage, compile-time type safety, and per-model cost attribution. Single static binary; adapters for Databricks, Snowflake, BigQuery, DuckDB. Apache 2.0.

15K 252 10

piperider-nightly

Code review for data in dbt

15K 494 23

airbyte-source-github

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

14K 21K 5K

airbyte-source-shopify

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

12K 21K 5K

airbyte-source-google-sheets

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

11K 21K 5K

ematix-flow

Move data between databases, files, and streams from Python. 5.87× faster than PySpark.

10K 0 0

airbyte-source-zendesk-support

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

10K 21K 5K

airbyte-source-faker

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

9K 21K 5K

airbyte-source-google-drive

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

9K 21K 5K

airbyte-source-bing-ads

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

8K 21K 5K

airbyte-source-google-analytics-data-api

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

8K 21K 5K

airbyte-source-gcs

Source implementation for Gcs.

8K 21K 5K

augraphy

Augmentation pipeline for rendering synthetic paper printing, faxing, scanning and copy machine processes

8K 536 61