Vision Transformer Python Packages

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

mmdet

OpenMMLab Detection Toolbox and Benchmark

mmcls

OpenMMLab Pre-training Toolbox and Benchmark

mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark

pix2tex

pix2tex: Using a ViT to convert images of equations into LaTeX code.

towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

attention-and-transformers

Transformers goes brrr... Attention and Transformers from scratch in TensorFlow. Currently contains Vision transformers, MobileViT-v1, MobileViT-v2, MobileViT-v3

mambavision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

vision-transformers

Vision Transformers for image classification, image segmentation, and object detection.

towhee-models

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

mist-medical

MIST: A simple and scalable end-to-end framework for 3D medical imaging segmentation.

fastervit

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

thepipe-api

Get clean data from tricky documents, powered by vision-language models ⚡

conformal-clip

Few-shot CLIP classification with conformal prediction, probability calibration, and reliability metrics.

clipq

A simple implementation of a CLIP that splits up an image into quandrants and then gets the embeddings for each quandrant

image-classification-jax

Image classification in JAX with ViT, resnet, cifar10, cifar100, imagenette, and imagenet

efficientvit-gml

Efficient vision foundation models for high-resolution generation and perception.

supreme-unlearning

A registry-based, multi-GPU framework for reproducible image-unlearning evaluation.

pai-easycv

An all-in-one toolkit for computer vision

autodistill-vit

ViT module for use with autodistill.

vit-flax

Implementation of Vision Transformers in Flax

deepvision-toolkit

PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/implementations - Vision Transformer (ViT), ResNetV2, EfficientNetV2, NeRF, SegFormer, MixTransformer, (planned...) DeepLabV3+, ConvNeXtV2, YOLO, etc.

vitaminp

VitaminP: a vision transformer-assisted multimodal integration network for pathology cell segmentation

clipcap

Using pretrained encoder and language models to generate captions from multimedia inputs.