Apache Iceberg Python Packages

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

37K 3K 225

dlt-iceberg

An Iceberg destination for DLT that supports REST catalogs

6K 14 6

odctl

A curated collection of open source technologies and the odctl CLI for running a local Docker-based data platform to experiment with modern data architecture and MLOps.

5K 10 0

datashard

Iceberg robustness, for the rest of us | S3 and Local safe file operations + Pandas support to query your data and logs.

2K 4 0

serverless-data-mesh

Serverless Data Mesh: proof-gated lakehouse writes on AWS Lambda (PVDM / Vaquar Pattern). PyPI + Docker. Apache-2.0 reference implementation.

2K 2 0

iceberg-zamboni

Iceberg table maintenance -- compaction, Z-order, partition evolution, snapshot expiry and orphan-file removal -- without needing Trino or Spark.

2K 0 0

laketower

Oversee your lakehouse

626 12 0

sparquet

Open-source data engineering framework for Apache Spark. Every pipeline is one declarative JSON contract: write it, generate it with any LLM, or design it visually in Sparquet Studio.

479 4 0

faceberg

Expose HuggingFace datasets as Apache Iceberg tables

345 32 3

prismnote

Fast, modern data-science notebook with built-in AI. Jupyter-compatible, integrated intelligence, SQL warehouse integration. PyPI: prismnote

261 1 1

cognimesh

Zero-code data mesh control plane: visual Step Functions pipelines, Vaquar PVDM proof-gated writes, AWS Design Review with inline fixes, Bedrock Agent Builder, marketplace & operations. Docker, PyPI, Terraform.

85 1 0