Captioning Python Packages

aac-metrics

Metrics for evaluating Automated Audio Captioning systems, designed for PyTorch.

aac-datasets

Audio Captioning datasets for PyTorch.

maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

setofmark

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

radfact-lite

text only radfact lib that also supports openai api and ollama

nori-captioner

Simple local web UI for captioning image/video datasets with optional local VLM auto-captioning

multimodal-maestro

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

musicalrecordingcaptioning

Caption recordings of musical theater, concerts, or any video with lyrics on Genius.com

aoa-pytorch

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering