Iceberg Python Packages

pyiceberg

PyIceberg

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

pydoris

Apache Doris is a real-time analytics and hybrid search database for AI agents.

opteryx-core

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

pynessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

apache-polaris

Apache Polaris, the interoperable, open source catalog for Apache Iceberg

opteryx

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

litelink

An embedded Iceberg storage engine for append-only data

pydoris-custom

Apache Doris is a real-time analytics and hybrid search database for AI agents.

streamcast

A JSON WebSocket pubsub framework for structured data.

open-lakehouse-contract

Open Lakehouse Contract (OLC) is an open YAML specification for declaring a data product's schema, quality rules, transformations, lineage, ownership, service levels (SLAs and SLOs) and materialisation.

ailake

AI-Lake Format: self-contained Parquet + HNSW index — unifying tabular data, embeddings, and vector search in a single Iceberg-compatible file

dlt-iceberg

An Iceberg destination for DLT that supports REST catalogs

dbt-doris

Apache Doris is a real-time analytics and hybrid search database for AI agents.

daft-lts

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

makotest

A Rust workspace for end-to-end German energy market communication (BDEW MaKo / EDI@Energy) — from raw EDIFACT bytes to production microservices.

icegraph-client

Interactive Apache Iceberg debugger for exploring production tables and tracing metadata evolution through AI and real time graph visualization.

datashard

Iceberg robustness, for the rest of us | S3 and Local safe file operations + Pandas support to query your data and logs.

beacondb

A high-performance climate data lake query engine supporting subsetting for zarr, netcdf, parquet, arrow ipc, csv, delta and iceberg

redpanda-polaris-catalog-python

Apache Polaris, the interoperable, open source catalog for Apache Iceberg

apache-airflow-providers-ailake

AI-Lake Format: self-contained Parquet + HNSW index — unifying tabular data, embeddings, and vector search in a single Iceberg-compatible file

iceberg-zamboni

Iceberg table maintenance -- compaction, Z-order, partition evolution, snapshot expiry and orphan-file removal -- without needing Trino or Spark.