Scalable Python Packages

hydra-zen

Create powerful Hydra applications without the yaml files and boilerplate code.

arboreto

A scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.

xorbits

Scalable Python DS & ML, in an API compatible & lightning fast way.

tomodachi

💻 Microservice lib designed to ease service building using Python and asyncio, with ready to use support for HTTP + WS, AWS SNS+SQS, RabbitMQ / AMQP, middlewares, envelopes, logging, lifecycles. Extend to GraphQL, protobuf, etc.

gordo

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

gordo-components

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

reposcanner

A lightweight CLI tool for rapid codebase analysis. Scan files, dependencies, and code metrics with zero configuration.

duckframework

Build high-performance, scalable, server-side reactive web applications — without a separate frontend framework or a complex JavaScript stack.

zenithlib

🚀 Zenith is a powerful Python framework that revolutionizes web development by enabling declarative and efficient UI components for building interactive and scalable websites.

bloomfilterpy

Scalable bloom filter using different backends written in Python

pymhss

Python scripts and data sets that can be used to reproduce the results presented in the paper "Metropolis-Hastings with Scalable Subsampling".

wf-dagger

A simple Python-based distributed workflow engine

swcdb

SWC-DB (Super Wide Column Database) - High Performance Scalable Database

brain-ai

BRAIN - a tool to Build projects and manage Resources for AI Newbies

pyxu

Modular and scalable computational imaging in Python with GPU/out-of-core computing.

animag

Anime magnet search library with strong scalability.

pycsou

Modular and scalable computational imaging in Python with GPU/out-of-core computing.

arkilian

An immutable database that follows Snowflake architecture, designed for scalable, replayable systems beyond analytics.

nbedr

Embedding Toolkit for RAG Applications

hysortod

Fast and Scalable Outlier Detection with Sorted Hypercubes