Gemm Python Packages

ctranslate2

Fast inference engine for Transformer models

nvidia-cudnn-frontend

cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it

tokenspeed-iris

AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming

trnblas

BLAS Levels 1–3 for AWS Trainium via NKI (cuBLAS-equivalent) — GEMM with stationary-tile reuse, batched GEMM, TRSM, validated DF-MP2 for quantum chemistry.

ctranslate2-arty

Fast inference engine for Transformer models

pyclblast

Tuned OpenCL BLAS

sparsemma

INT8 Sparse Tensor Core GEMM kernels for PyTorch — built for Windows