Multi Modality Python Packages

bert-serving-client

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

bert-serving-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

clip-as-service

Embed images and sentences into fixed-length vectors via CLIP

clip-server

Embed images and sentences into fixed-length vectors via CLIP

clip-client

Embed images and sentences into fixed-length vectors via CLIP

deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

open-gpt-torch

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

visionzip

Official repository for VisionZip (CVPR 2025)

llava-torch

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

gemini-torch

The open source implementation of Gemini, the model that will "eclipse ChatGPT" by Google

sophia-optimizer

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

andromeda-llm

andromeda - Pytorch

andromeda-torch

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

tiny-gptv

Tiny GPTV - Pytorch

mm1-torch

PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"

andromeda-transformer

andromeda - Pytorch

rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

v-clip-server

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

thebestllmever

An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast

the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

hsss

Implementation of a Hierarchical Mamba as described in the paper: "Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling"

aoa-torch

Attention on Attention - Pytorch

otter-ai

Otter: A Multi-Modal Model with In-Context Instruction Tuning

open-gpts

An open-source cloud-native of large multi-modal models (LMMs) serving framework.