PyRank

Dataengineering Python Packages

Python packages with the GitHub topic dataengineering. Sorted by relevance, with stars and monthly downloads.
datafold
collate-data-diff

Compare tables within or across databases

900K 3K 309
SQLMesh
sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

567K 3K 413
open-metadata
openmetadata-ingestion

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

364K 14K 2K
open-metadata
openmetadata-managed-apis

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

90K 14K 2K
datafold
data-diff

Compare tables within or across databases

44K 3K 309
awslabs
aws-ddk-core

An open source development framework to help you build data workflows and modern data architecture on AWS.

3K 272 24
afogarty85
camelcasing

Official repository for the camelCasing package

3K 2 0
zinggAI
zingg

Scalable master data management, identity resolution, entity resolution, and deduplication using ML

3K 1K 169
open-metadata
openmetadata-ingestion-core

The Open Context Layer for Data and AI , OpenMetadata is the open platform for building trusted data context and business semantics for humans, AI assistants, and agents.

2K 14K 2K
prodmodel
prodmodel

Build, test, deploy, iterate - Dev and prod tool for data science pipelines

2K 58 3
vvaneecloo
dbt-addons

A super simple dbt wrapper that handles the boring stuff for you (WAP, state, deployment, artefacts etc.)

2K 5 1
grai-io
grai-schemas

No description available

1K 315 20
grai-io
grai-client

No description available

1K 315 20
awslabs
aws-orbit-overprovisioning

A Data Platform built for AWS, powered by Kubernetes.

1K 147 92
grai-io
grai-source-dbt

No description available

1K 315 20
grai-io
grai-source-bigquery

No description available

789 315 20
grai-io
grai-source-snowflake

No description available

776 315 20
grai-io
grai-source-postgres

No description available

775 315 20
Edwardvaneechoud
pyfloe

A minimal zero dependency dataframe library

754 6 0
awslabs
aws-orbit

A Data Platform built for AWS, powered by Kubernetes.

711 147 92
awslabs
aws-orbit-sdk

A Data Platform built for AWS, powered by Kubernetes.

709 147 92
awslabs
aws-orbit-hello-world

A Data Platform built for AWS, powered by Kubernetes.

700 147 92
grai-io
grai-graph

No description available

691 315 20
awslabs
aws-orbit-custom-cfn

A Data Platform built for AWS, powered by Kubernetes.

688 147 92