Multi Modality Python Packages

bert-serving-client

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

bert-serving-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-client

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

open-gpt-torch

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

gemini-torch

The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google

llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

visionzip

Official repository for VisionZip (CVPR 2025)

andromeda-llm

andromeda - Pytorch

andromeda-torch

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

tiny-gptv

Tiny GPTV - Pytorch

andromeda-transformer

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

sophia-optimizer

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

mm1-torch

PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"

rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

thebestllmever

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

v-clip-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

hsss

Paper - Pytorch

aoa-torch

Implementation of Attention on Attention in Zeta

hrtx

Multi-Modal Multi-Embodied Hivemind-like Iteration of RTX-2

open-gpts

An open-source implementation of large-scale language model (LLM).

otter-ai

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.