Data Management Python Packages

dvc-data

DVC's data management subsystem

geoh5py

Python API for geoh5, an open file format for geoscientific data.

pylerc

Limited Error Raster Compression

rucio-clients

Rucio - Scientific Data Management

osfclient

A python library and command-line client for file storage on OSF

lerc

Limited Error Raster Compression

welly

Welly helps with well loading, wireline logs, log quality, data science

girder-import-tracker

A data management platform for the web, developed by Kitware

signac

Manage large and heterogeneous data spaces on the file system.

datannurpy

Python toolkit to scan files and databases into ready-to-use datannur catalogs

rucio

Rucio - Scientific Data Management

tpcp

Pipeline and Dataset helpers for complex algorithm evaluation.

wdmtoolbox

Command line script and Python package to work with Hydrological Simulation Programs-FORTRAN (HSPF) Watershed Data Management (WDM) files.

rucio-webui

Rucio - Scientific Data Management

hydroserverpy

Open-source platform for ingesting, managing, and sharing hydrological time series data

memorizz

MemoRizz: A Python library serving as a memory layer for AI applications. Leverages popular databases and storage solutions to optimize memory usage. Provides utility classes and methods for efficient data management.

elastro-client

A comprehensive Python library for Elasticsearch management with both programmatic and CLI interfaces

pastastore

:spaghetti: :convenience_store: Tools for managing timeseries and Pastas models

dafab-client

Rucio - Scientific Data Management

h5rdmtoolbox

Supporting a FAIR Research Data lifecycle using Python and HDF5.

datashuttle

Tool for the creation, validation and transfer of neuroscience project folders.

isatools

ISA tools API

pyvelox

A composable and fully extensible C++ execution engine library for data management systems.

datalab-server

datalab is a place to store experimental data and the connections between them.