Vision And Language Python Packages

factualscenegraph

[ACL 2023 Findings] FACTUAL dataset, the textual scene graph parser trained on FACTUAL.

mammoclip

[MICCAI 2024, top 11%] Official Pytorch implementation of Mammo-CLIP: A Vision Language Foundation Model to Enhance Data Efficiency and Robustness in Mammography

maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

multimodal

A collection of multimodal datasets, and visual features for VQA and captionning in pytorch. Just run "pip install multimodal"

modu-muse

Modular + Muse, for inspiring multimodal intelligence.

eccv-caption

Extended COCO Validation (ECCV) Caption dataset (ECCV 2022)

multimodal-maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

mozuma

Model Zoo for Multimedia Applications

omagent-core

[EMNLP-2024] Build multimodal language agents for fast prototype and production

setofmark

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL