Cluster Python Packages

hdijupyterutils

Jupyter magics and kernels for working with remote Spark clusters

autovizwidget

Jupyter magics and kernels for working with remote Spark clusters

skein

A tool and library for easily deploying applications on Apache YARN

sparkmagic

Jupyter magics and kernels for working with remote Spark clusters

openquake-engine

OpenQuake Engine: a software for Seismic Hazard and Risk Analysis

tensorflowonspark

TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.

bexhoma

This python tool helps managing DBMS benchmarking experiments in a Kubernetes-based HPC cluster environment. It enables users to configure hardware / software setups for easily repeating tests over varying configurations.

pepperize-cdk-serverless-cluster-from-snapshot

Deprecated: Use https://docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_rds.ServerlessClusterFromSnapshot.html

aioredis-cluster

Redis Cluster support extension for aioredis

libgossip

A C++17 implementation of the Gossip protocol, designed for decentralized distributed systems.

classicml

An easy-to-use ML framework

sonar

Tool to profile usage of HPC resources by regularly probing processes.

casty

A minimalist, type-safe actor framework for Python 3.12+ with built-in distributed clustering

srunx

A modern Python library for SLURM workload manager integration with workflow orchestration capabilities.

hipart

Hierarchical divisive clustering algorithm execution, visualization and Interactive visualization.

gap-stat

Dynamically get the suggested clusters in the data for unsupervised learning.

rediscluster

a Python interface to a Cluster of Redis key-value store

spatial-cluster-compare

Automated benchmarking and selection of clustering algorithms (KMeans, Agglomerative, Spectral, GMM, DBSCAN) for spatial/multiplex immunofluorescence data, using Hopkins statistic, PCA, multi-metric evaluation (Silhouette, Davies-Bouldin, Calinski-Harabasz, ARI stability) and automatic best-method selection.

keep-gpu

KeepGPU is a simple CLI app that keeps your GPUs running.

sparkctl

Orchestrates Spark clusters on HPCs

hyper-shell

A cross-platform, high-throughput computing utility for processing shell commands over a distributed, asynchronous queue.

arvados-pam

An open source platform for managing and analyzing biomedical big data

classicml-python

An easy-to-use ML framework

runjob

No description available