Object Storage Python Packages

lakefs-sdk

lakeFS - Data version control for your data lake | Git for data

lakefs

lakeFS - Data version control for your data lake | Git for data

aistore

AIStore: scalable storage for AI applications

ocifs

ocifs provides a POSIX-compatible API wrapping Oracle Cloud Infrastructure's (OCI) Object Storage. ocifs is a python library that relies on the fsspec framework.

lithops

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud ☁️🚀

object-storage-charmlib

An operator charm providing an integrator for connecting to S3 or Azure or GCS provides.

cloud-files

Threaded Python and CLI client library for AWS S3, Google Cloud Storage (GCS), in-memory, and the local filesystem.

datajoint

Relational Workflows: where database schemas define executable data pipelines.

infino

Embedded retrieval library built on Parquet. Fast, efficient, and scalable.

lakefs-client

lakeFS - Data version control for your data lake | Git for data

namidb

Graph database native to the cloud. Embedded, multi-tenant, built on object storage.

glyd

Lossless AI compression: 33% less GPU memory, bit for bit.

object-storage-proxy

Fast in-process object storage reverse proxy with python interface.

scarf

Memory-efficient single-cell analysis in Python. Stream RNA, ATAC, CITE-seq and multi-omics from local or remote Zarr stores, from laptop to atlas scale, with reusable fingerprinted results.

fastenv

⚙️ Unified environment variable and settings management for FastAPI and beyond 🚀

bucket-scanner

Declared vs real — Object Storage security scanner (Yandex Cloud + AWS S3 + Azure + GCS)

remote-store

Write file storage code once. Run it against local files, S3, SFTP, Azure, or OneDrive.

langchain-infino

LangChain partner package for Infino — vector, BM25, and hybrid (RRF) retrieval over one engine.

ha-s3-media-core

Home Assistant media source for photos, recordings and audio in S3-compatible storage (RustFS, Ceph, R2, AWS S3), backed by a Rust/PyO3 client

openbucket-client

Turn any local disk or folder into S3-compatible object storage — one daemon, one CLI, a live dashboard, and an optional free public tunnel.

pywren-ibm-cloud

A multi-cloud framework for big data analytics and embarrassingly parallel jobs, that provides a universal API for building parallel applications in the cloud ☁️🚀

llama-index-vector-stores-infino

LlamaIndex integration for Infino — vector, BM25, hybrid (RRF), and SQL retrieval over one engine on object storage.

cytearc

Fast, out-of-core single-cell analysis in Python for RNA, ATAC, protein, and multi-omic data, scaling to 100M+ cells. Mount remote datasets, work within a memory budget, and trace every result through built-in provenance.

streamsx-objectstorage

The com.ibm.streamsx.objectstorage toolkit supports Object Storage services with S3 API like IBM Cloud Object Storage service.