Scalable Python Packages

hydra-zen

Create powerful Hydra applications without the yaml files and boilerplate code.

arboreto

A scalable python-based framework for gene regulatory network inference using tree-based ensemble regressors.

xorbits

Scalable Python DS & ML, in an API compatible & lightning fast way.

tomodachi

💻 Microservice lib designed to ease service building using Python and asyncio, with ready to use support for HTTP + WS, AWS SNS+SQS, RabbitMQ / AMQP, middlewares, envelopes, logging, lifecycles. Extend to GraphQL, protobuf, etc.

gordo

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

zenithlib

Zenith is a powerful Python framework that revolutionizes web development by enabling declarative and efficient UI components for building interactive and scalable websites.

gordo-components

An API-first distributed deployment system of deep learning models using timeseries data to predict the behaviour of systems

bloomfilterpy

Scalable bloom filter using different backends written in Python

brain-ai

BRAIN - a tool to Build projects and manage Resources for AI Newbies

pymhss

Python scripts and data sets that can be used to reproduce the results presented in the paper "Metropolis-Hastings with Scalable Subsampling".

arkilian

An immutable database that follows Snowflake architecture, designed for scalable, replayable systems beyond analytics.

swcdb

SWC-DB (Super Wide Column Database) - High Performance Scalable Database

wf-dagger

A simple Python-based distributed workflow engine

pyxu

Modular and scalable computational imaging in Python with support for GPU/out-of-core computing.

animag

Anime magnet search library with strong scalability.

duckframework

Duck is a powerful, open-source, full-fledged Python-based web server, framework, and reverse proxy designed for building modern, customizable web applications — from small sites to large-scale platforms.

nbedr

Embedding Toolkit for RAG Applications

pycsou

Modular and scalable computational imaging in Python with GPU/out-of-core computing.

hysortod

Fast and Scalable Outlier Detection with Sorted Hypercubes