Large Scale Python Packages

camel-oasis

🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents.

es-pandas

Read, write and update large scale pandas DataFrame with Elasticsearch

colossalai

Making large AI models cheaper, faster and more accessible

torchdr

TorchDR - PyTorch Dimensionality Reduction

colossalai-nightly

Making large AI models cheaper, faster and more accessible

brayns

Brayns Python API

parl

A high-performance distributed training framework for Reinforcement Learning

facedb

A package designed for efficient face recognition across extensive photo collections, optimized for large-scale processing.

ms-mint-app

Metabolomics Integrator Interactive Web-Application (Mint)

ms-mint-app2

MS-MINT is a Python application for processing, analyzing, and visualizing large liquid chromatography-mass spectrometry (LC-MS) metabolomics datasets

fleet-x

No description available

quick-batch

ultra simple command line tool for docker-scaling batch processing

pyccea

A Python package of cooperative co-evolutionary algorithms for feature selection in high-dimensional data.

custom-colossalai

Making large AI models cheaper, faster and more accessible

data-selection

DSIR large-scale data selection framework for language model training

neorl

NeuroEvolution Optimization with Reinforcement Learning

ringer

Large-scale data structures hosted on the file-system

fleet-lightning

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

redis-bulk-cleaner

No description available

gigl

TODO

ls-mcmc

A light-weight library for large-scale Markov Chain Monte Carlo sampling

xdeeprank

An eXtensible Package of Deep Learning based Ranking Models for Large-scale Industrial Recommender System with Tensorflow

plsc

Paddle Large Scale Classification Tools，supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT, Swin, DeiT, CaiT, FaceViT, MoCo, MAE, ConvMAE, CAE.

ltb-symm

LTB-Symm is a publicly available code that does two things: large scale tight-binding (LTB) calculation of 2D materials, and checks topological symmetries (Symm) of their wave functions.