PyRank
  • Search
  • PyPI
  • GitHub
  • Insights
  • Compare
  • Advisories
  • Ecosystem
  • About

Dataengineering Python Packages

Python packages with the GitHub topic dataengineering. Sorted by monthly downloads, with stars and forks.
SQLMesh
sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

508K 3K 475
datafold
collate-data-diff

Compare tables within or across databases

282K 3K 316
datafold
data-diff

Compare tables within or across databases

21K 3K 316
csvpath
csvpath

Data Engineering infrastructure that controls inbound tabular data file feeds and validates data contracts

4K 17 3
SEPURI-SAI-KRISHNA
pandas-blame

Cell-level why for pandas pipelines. No code changes.

2K 0 0
awslabs
aws-ddk-core

An open source development framework to help you build data workflows and modern data architecture on AWS.

2K 271 24
zinggAI
zingg

Scalable master data management, identity resolution, entity resolution, and deduplication using ML

1K 1K 178
grai-io
grai-schemas

No description available

1K 317 20
grai-io
grai-client

No description available

1K 317 20
grai-io
grai-source-dbt

No description available

898 317 20
grai-io
grai-source-bigquery

No description available

626 317 20
grai-io
grai-source-snowflake

No description available

598 317 20
grai-io
grai-source-postgres

No description available

594 317 20
awslabs
aws-orbit-hello-world

A Data Platform built for AWS, powered by Kubernetes.

583 147 92
awslabs
aws-orbit-sdk

A Data Platform built for AWS, powered by Kubernetes.

560 147 92
awslabs
aws-orbit

A Data Platform built for AWS, powered by Kubernetes.

551 147 92
awslabs
aws-orbit-code-commit

A Data Platform built for AWS, powered by Kubernetes.

541 147 92
awslabs
aws-orbit-team-script-launcher

A Data Platform built for AWS, powered by Kubernetes.

538 147 92
awslabs
aws-orbit-custom-cfn

A Data Platform built for AWS, powered by Kubernetes.

530 147 92
grai-io
grai-graph

No description available

525 317 20
awslabs
aws-orbit-redshift

A Data Platform built for AWS, powered by Kubernetes.

517 147 92
grai-io
grai-source-mssql

No description available

485 317 20
fvaleye
metadata-guardian

Provide an easy way with Python to protect your data sources by searching its metadata. 🛡️

475 18 1
awslabs
aws-orbit-emr-on-eks

A Data Platform built for AWS, powered by Kubernetes.

473 147 92
    • Original data from PyPI, GitHub, and OSV; downloads served through ClickHouse
    • Sources & methodology