Data Storage Python Packages

datalad

Keep code, data, containers under control with git and git-annex

alpharaw

An open-source Python package to unify raw MS data accession and storage.

pfeed

Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

columnfile

Simple library to manage local file storage within an application based on the concept of local partition and sort keys

data-place

A powerfull and flexible framework for designing async socket based data streaming and destribution systems, with automated parsing, dynamic data store and high-level control hooks.

eco-connect

A wrapper for connecting to Ecorithm's API Platform through Python

dh5

Dictionary H5 — package that enables the seamless manipulation of HDF5 files, treating them like traditional dictionaries.

sharedb

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

data-vault

IPython magic for simple, organized, compressed and encrypted: storage & transfer of files between notebooks.

filexdb

A lightweight, dependency-free, file-based NoSQL database for Python with simple collection/document APIs.

jflatdb

jflatdb — The next-gen lightweight JSON database for Python, built for speed, simplicity, and secure local data management.

bitdust-p2p

BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

dnastore

An open-source framework for building applications on DNA data storage, providing a familiar object storage API, realistic simulation, and support for future integration with physical DNA storage technologies.

bingenetic

This repository contains a simple python library to convert binary data to genetic codes and further genetic codes back to binary data.

chronostore

Fast binary time series store for Python. No DB, no server, just mmap.

securedatatransfer

The Secure Data Transfer device combines Raspberry Pi-based hardware with user-friendly Python scripts for seamless and secure file encryption and transfer, enhancing data privacy.

labinform

Python components of the laboratory information system LabInform