PyRank

Datafusion Python Packages

Python packages with the GitHub topic datafusion. Sorted by relevance, with stars and monthly downloads.
ibis-project
ibis-framework

the portable Python dataframe library

2.7M 7K 738
lakehq
pysail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

38K 3K 188
jeroenflvr
datap-rs

A config-driven Rust server that publishes Parquet and Delta datasets as fast, typed HTTP APIs from local disk or object storage, with interchangeable DuckDB or Arrow+DataFusion backends, JSON and Arrow IPC output, and production-ready features like auth, metrics, and hot reloads.

26K 0 0
clement-tourriere
dbcrust

Fast psql-style database CLI/workbench for PostgreSQL, MySQL, SQLite, ClickHouse, MongoDB, Elasticsearch, and SQL over Parquet/CSV/JSON — with optional AI, SSH/Vault, Python & Django.

16K 89 1
jeroenflvr
datap-rs-client

A config-driven Rust server that publishes Parquet and Delta datasets as fast, typed HTTP APIs from local disk or object storage, with interchangeable DuckDB or Arrow+DataFusion backends, JSON and Arrow IPC output, and production-ready features like auth, metrics, and hot reloads.

14K 0 0
ryan-evans-git
ematix-flow

Move data between databases, files, and streams from Python.

7K 0 0
strake-data
strake

The Data Layer for AI. A high-performance federated SQL engine that gives AI agents governed, zero-copy access to your entire data stack (Postgres, S3, APIs).

3K 4 1
mag1cfrog
deltafunnel

Fast, lightweight Delta Lake to SQL Server loads without Spark or ODBC.

3K 0 0
madesroches
micromegas

Scalable Observability

2K 47 7
roapi
roapi

Create full-fledged APIs for slowly moving datasets without writing a single line of code.

1K 3K 210
mag1cfrog
timeseries-table-format

Rust-native time-series table format with gap/overlap tracking and SQL queries

1K 16 1
roapi
columnq-cli

No description available

815 3K 210
roapi
roapi-http

No description available

773 3K 210
jychen7
bigtableql

SQL Query Layer for Google Cloud Bigtable

401 1 0
lakesoul-io
lakesoul

Python APIs for using LakeSoul

345 3K 417
ibis-project
turntable-spoonbill

the portable Python dataframe library

291 7K 738
lostmygithubaccount
ibis-bench

benchmarking with Ibis

286 1 1
georgeleepatterson
clickarrow

High-performance ClickHouse client with native protocol and Arrow integration

271 48 14
jychen7
bigql

Query Layer for Google Cloud Bigtable

219 1 0
singhpratech
samkhya

Portable, feedback-driven cardinality correction

103 0 0
apache
datafusion-cli

Apache DataFusion SQL Query Engine

1 9K 2K