Vision Transformer Python Packages

mmdet

OpenMMLab Detection Toolbox and Benchmark

mlx-vlm

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

mmcls

OpenMMLab Pre-training Toolbox and Benchmark

mmpretrain

OpenMMLab Pre-training Toolbox and Benchmark

pix2tex

pix2tex: Using a ViT to convert images of equations into LaTeX code.

mambavision

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

thepipe-api

Get clean data from tricky documents, powered by VLMs.

towhee

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

attention-and-transformers

Transformers goes brrr... Attention and Transformers from scratch in TensorFlow. Currently contains Vision transformers, MobileViT-v1, MobileViT-v2, MobileViT-v3

vision-transformers

Vision Transformers for image classification, image segmentation, and object detection.

clipq

A simple implementation of a CLIP that splits up an image into quandrants and then gets the embeddings for each quandrant

conformal-clip

Few-shot CLIP classification with conformal prediction, probability calibration, and reliability metrics.

towhee-models

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

mist-medical

MIST is a simple and scalable end-to-end framework for medical imaging segmentation.

fastervit

[ICLR 2024] Official PyTorch implementation of FasterViT: Fast Vision Transformers with Hierarchical Attention

pai-easycv

An all-in-one toolkit for computer vision

image-classification-jax

Image classification in JAX with ViT, resnet, cifar10, cifar100, imagenette, and imagenet

timme

timm, evolved

efficientvit-gml

open-set object detector

deepvision-toolkit

PyTorch and TensorFlow/Keras image models with automatic weight conversions and equal API/implementations - Vision Transformer (ViT), ResNetV2, EfficientNetV2, NeRF, SegFormer, MixTransformer, (planned...) DeepLabV3+, ConvNeXtV2, YOLO, etc.

tfimm

TensorFlow port of PyTorch Image Models (timm) - image models with pretrained weights

autodistill-vit

ViT module for use with autodistill.

clipcap

Using pretrained encoder and language models to generate captions from multimedia inputs.

vit-flax

Implementation of Vision Transformers in Flax