Datafusion Python Packages

ibis-framework

the portable Python dataframe library

pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

dataprof

Library and CLI for profiling tabular data

ematix-flow

Move data between databases, files, and streams from Python. 5.87× faster than PySpark.

strake

The Data Layer for AI. A high-performance federated SQL engine that gives AI agents governed, zero-copy access to your entire data stack (Postgres, S3, APIs).

roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

micromegas

Python analytics client for the Micromegas observability platform

roapi-http

No description available

columnq-cli

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

timeseries-table-format

Rust-native time-series table format with gap/overlap tracking and SQL queries

bigtableql

Query Layer for Google Cloud Bigtable

turntable-spoonbill

the portable Python dataframe library

ibis-bench

A composable data system benchmark in a Python package.

clickarrow

ClickHouse Native Protocol Rust Client w/ Arrow Compatibility

bigql

Query Layer for Google Cloud Bigtable

lakesoul

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

datafusion-cli

Apache DataFusion SQL Query Engine