Data Management Python Packages

dvc-data

DVC's data management subsystem

pylerc

Limited Error Raster Compression

rucio-clients

Rucio - Scientific Data Management

osfclient

A python library and command-line client for file storage on OSF

lerc

Limited Error Raster Compression

signac

Manage large and heterogeneous data spaces on the file system.

girder-import-tracker

A data management platform for the web, developed by Kitware

rucio

Rucio - Scientific Data Management

welly

Welly helps with well loading, wireline logs, log quality, data science

rucio-webui

Rucio - Scientific Data Management

geoh5py

Python API for geoh5, an open file format for geoscientific data

tpcp

Pipeline and Dataset helpers for complex algorithm evaluation.

memorizz

MemoRizz: A Python library serving as a memory layer for AI applications. Leverages popular databases and storage solutions to optimize memory usage. Provides utility classes and methods for efficient data management.

hydroserverpy

Open-source platform for ingesting, managing, and sharing hydrological time series data

wdmtoolbox

Command line script and Python package to work with Hydrological Simulation Programs-FORTRAN (HSPF) Watershed Data Management (WDM) files.

datannurpy

Python toolkit to scan files and databases into ready-to-use datannur catalogs

datalab-server

datalab is a place to store experimental data and the connections between them.

pastastore

:spaghetti: :convenience_store: Tools for managing timeseries and Pastas models

elastro-client

A comprehensive Python library for Elasticsearch management with both programmatic and CLI interfaces

h5rdmtoolbox

Supporting a FAIR Research Data lifecycle using Python and HDF5.

pyvelox

A composable and fully extensible C++ execution engine library for data management systems.

ckanext-selfinfo

Keep your CKAN healthy! 🩺 ckanext-selfinfo gives admins crucial real-time system, usage, and error telemetry directly in the CKAN interface. Tools for CKAN. Lightweight tracking system.

isatools

ISA tools API

mira-omf

Python library for working with OMF files, with conversion between OMF and GEOH5 files