Captioning Python Packages

aac-datasets

Audio Captioning datasets for PyTorch.

aac-metrics

Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.

maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

aoa-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

radfact-lite

Lightweight text-only RadFact metric with OpenAI and Ollama backends

musicalrecordingcaptioning

Caption recordings of musical theater, concerts, or any video with lyrics on Genius.com

multimodal-maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

setofmark

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL