Multimodality Python Packages

fedot

Automated modeling and machine learning framework FEDOT

fuse-med-ml

A python framework accelerating ML based discovery in the medical field by encouraging code reuse. Batteries included :)

big-sleep

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

navit-torch

My implementation of "Patch n’ Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution"

tenderness

Text rendering library for synthetic data generation

emmental

A deep learning framework for building multimodal multi-task learning systems.

fonduer

A knowledge base construction engine for richly formatted data

mirasol-pytorch

Implementation of 🌻 Mirasol, SOTA Multimodal Autoregressive model out of Google Deepmind, in Pytorch

swarms-torch

Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊

pali-torch

Democratization of "PaLI: A Jointly-Scaled Multilingual Language-Image Model"

medpalm

MedPalm - Pytorch

nmtpytorch

Sequence-to-Sequence Framework in PyTorch

tfce-mediation

Fast regression and mediation analysis of vertex or voxel MRI data with TFCE

pydance

DANCE: a deep learning library and benchmark platform for single-cell analysis

pali3

pali3 - Pytorch

tmi-viewer

Fast regression and mediation analysis of vertex or voxel MRI data with TFCE

mmqqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

fedot-example-test

Automated modeling and machine learning framework FEDOT

sygra

Graph-oriented Synthetic data generation Pipeline library

mmca

The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention"

mmca-mgqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention

mmmgqa

Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention