Large Scale Python Packages

camel-oasis

🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.

colossalai

Making large AI models cheaper, faster and more accessible

es-pandas

Read, write and update large scale pandas DataFrame with Elasticsearch

torchdr

TorchDR - PyTorch Dimensionality Reduction

colossalai-nightly

Making large AI models cheaper, faster and more accessible

ms-mint-app

Web-based post-processing tool for LC-MS metabolomics data. Extract, visualize, and analyze targeted metabolites with interactive browser-based interface.

facedb

A python package for face database management

parl

A high-performance distributed training framework for Reinforcement Learning

brayns

Visualizer for large-scale and interactive ray-tracing of neurons

custom-colossalai

An integrated large-scale model training system with efficient parallelization techniques

ms-mint-app2

MS-MINT is a Python application for processing, analyzing, and visualizing large liquid chromatography-mass spectrometry (LC-MS) metabolomics datasets

fleet-x

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

neorl

NeuroEvolution Optimization with Reinforcement Learning

quick-batch

ultra simple command line tool for docker-scaling batch processing

data-selection

Data Selection with Importance Resampling

redis-bulk-cleaner

Deletes keys from Redis database in bulk.

pyccea

A Python package of cooperative co-evolutionary algorithms for feature selection in high-dimensional data.

ringer

Large-scale data structures hosted on the file-system

fleet-lightning

No description available

ls-mcmc

A light-weight library for large-scale Markov Chain Monte Carlo sampling

gigl

TODO

plsc

PLSC is an open source repo for a collection of Paddle Large Scale Classification Tools, which supports large-scale classification model pre-training as well as finetune for downstream tasks.

xdeeprank

An eXtensible Package of Deep Learning based Ranking Models for Large-scale Industrial Recommender System with Tensorflow

paddle-fleet

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。