Data Storage Python Packages

datalad

Keep code, data, containers under control with git and git-annex

alpharaw

An open-source Python package to unify raw MS data accession and storage.

pfeed

Data Engine for AI/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

darr

A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

data-place

A powerfull and flexible framework for designing async socket based data streaming and destribution systems, with automated parsing, dynamic data store and high-level control hooks.

columnfile

Simple library to manage local file storage within an application based on the concept of local partition and sort keys

eco-connect

A wrapper for connecting to Ecorithm's API Platform through Python

data-vault

IPython magic for simple, organized, compressed and encrypted storage of files

dh5

Dictionary H5 — package that enables the seamless manipulation of HDF5 files, treating them like traditional dictionaries.

filexdb

A lightweight, dependency-free, file-based NoSQL database for Python with simple collection/document APIs.

sharedb

An on-disk pythonic embedded key-value store for compressed data storage and distributed data analysis

jflatdb

A lightweight JSON-based flat file database system.

bingenetic

This repository contains a simple python library to convert binary data to genetic codes and further genetic codes back to binary data.

bitdust-p2p

BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

securedatatransfer

The Secure Data Transfer device combines Raspberry Pi-based hardware with user-friendly Python scripts for seamless and secure file encryption and transfer, enhancing data privacy.

chronostore

Fast binary time series store for Python. No DB, no server, just mmap.

labinform

Python components of the laboratory information system LabInform