Delta Lake Python Packages

delta-spark

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

deltalake

A native Rust library for Delta Lake, with bindings into Python

delta-sharing

An open protocol for secure data sharing

koheesio

Python framework for building efficient data pipelines. It promotes modularity and collaboration, enabling the creation of complex pipelines from simple, reusable components.

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

pydoris-custom

Apache Doris is an easy-to-use, high performance and unified analytics database.

pydoris

Apache Doris is an easy-to-use, high performance and unified analytics database.

hops-deltalake

A native Rust library for Delta Lake, with bindings into Python

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

dask-deltatable

A Delta Lake reader for Dask

cdk-emrserverless-with-delta-lake

This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you could also launch an EMR notebook via cluster template to check the outcome from the EMR Serverless application.

delta-lake-reader

Read Delta tables without any Spark

ematix-flow

Move data between databases, files, and streams from Python.

lakehouse-engine

The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.

sqllocks-spindle

Multi-domain, schema-aware synthetic data generator for Microsoft Fabric. 13 domains, billion-row scale, statistically calibrated. Lakehouse · Warehouse · SQL DB · Eventhouse writers.

pfeed

Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

dbt-doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

deltafunnel

Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.

roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

sqlshell

A powerful SQL shell with GUI interface for data analysis

duckalog

Build DuckDB catalogs from declarative YAML/JSON configuration files

deltagraphar

A transactional, time-traveling property-graph store on GraphAr, versioned with LakeFS.

data-hub-gandalf

SCD (Types 0-6), upsert, surrogate key, checksum, and guarded Delta merge library for Databricks over Spark Connect — you shall not pass... bad data.

columnq-cli

Create full-fledged APIs for slowly moving datasets without writing a single line of code.