Late Interaction Python Packages

topk-sdk

High-quality search for AI-native applications.

lateweave

Composable candidate generation and optional late-interaction (MaxSim) reranking, in Rust with Python bindings

raglite

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with DuckDB or PostgreSQL

pylate-rs

PyLate efficient inference engine

late-interaction-kernels

Fused Triton kernels for late-interaction (MaxSim) scoring

latence-solver

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

pylate-rs-mkl

PyLate efficient inference engine

pymuvera

Python library for MUVERA multi-vector retrieval via Fixed Dimensional Encodings. ColBERT / ColQwen2 / ColQwen3.5 compatible.

voyager-index

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

jina-v4-vllm-plugin

Serve Jina Embeddings v4 multi-vector (ColBERT-style) multimodal text+image embeddings from a stock vLLM OpenAI server via an out-of-tree plugin, with configurable image fidelity.

pylate-rs-metal

PyLate efficient inference engine

pylate-rs-accelerate

PyLate efficient inference engine

colsearch

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

pylate-rs-cuda

PyLate efficient inference engine