Iceberg Python Packages

pyiceberg

PyIceberg

daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

starrocks

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance for multi-dimensional analytics, real-time analytics, and ad-hoc queries. A Linux Foundation project.

pydoris-custom

Apache Doris is an easy-to-use, high performance and unified analytics database.

pydoris

Apache Doris is an easy-to-use, high performance and unified analytics database.

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

opteryx

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

pynessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics

ailake

AI-Lake Format: self-contained Parquet + HNSW index — unifying tabular data, embeddings, and vector search in a single Iceberg-compatible file

dlt-iceberg

An Iceberg destination for DLT that supports REST catalogs

daft-lts

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

opteryx-core

🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.

dbt-doris

Apache Doris is an easy-to-use, high performance and unified analytics database.

pyiceberg-dlf

PyIceberg

redpanda-polaris-catalog-python

Apache Polaris, the interoperable, open source catalog for Apache Iceberg

datashard

Iceberg robustness, for the rest of us | S3 and Local safe file operations + Pandas support to query your data and logs.

apache-polaris

Apache Polaris, the interoperable, open source catalog for Apache Iceberg

pyducklake

Python toolkit for working with Ducklake

duckalog

Build DuckDB catalogs from declarative YAML/JSON configuration files

arrowjet

The fastest way to move data in and out of database.

datacoolie

Metadata-driven ETL framework for portable data pipelines across Polars, Spark, Fabric, Databricks, and AWS.

torch-dataloader-utils

Efficient Data Loader Utils for loading data from structured sources into Pytorch

duckberg

Python package for querying iceberg data through duckdb.

sql2arrow

This is a Python library that provides convenient and high-performance methods to parse INSERT SQL statements into Arrow arrays.