Triton Kernels Python Packages

liger-kernel

Efficient Triton Kernels for LLM Training

liger-kernel-nightly

Efficient Triton Kernels for LLM Training

conch-triton-kernels

A "standard library" of Triton kernels.

flag-gems

FlagGems is an operator library for large language models implemented in the Triton Language.

neurobrix

Universal AI Runtime — Execute any model on any hardware

vllm-factory

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

latence-solver

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

flashcart

Fast Cartesian tensor operations and equivariant interatomic potentials for atomistic simulations

voyager-index

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

rfdetr-ghost

Drop-in performance optimization layer for RF-DETR using custom fused CuteDSL & Triton kernels: same API, significantly faster execution.

colsearch

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

nano-triton

A from-scratch nano-Triton and nano-Helion: the modern GPU-kernel DSL stack, rebuilt in ~4,000 lines

xjh-gems

FlagGems is an operator library for large language models implemented in the Triton Language.