Avx2 Python Packages

ctranslate2

Fast inference engine for Transformer models

turbocpp

Fast CPU LLM inference in pure C++17. AVX2+FMA matmul, Q4/Q8 quantization, TurboQuant-style 4/3-bit KV cache, GQA, BPE, mmap loader. Zero deps.

corrfunc

⚡️⚡️⚡️Blazing fast correlation functions on the CPU.

osaca

Open Source Architecture Code Analyzer

ctranslate2-arty

Fast inference engine for Transformer models

detect-simd

Python library to detect CPU SIMD capabilities.

adaptq

High-performance CPU KV-cache quantization engine for LLM inference (~10× speedup, 4× memory reduction) with Python & PyTorch support.

ea-compiler

Eä compute kernel compiler for Python — write SIMD kernels, call from NumPy

eastat

CSV column statistics powered by Ea SIMD kernels.

residue-protocol

Bare-Metal AVX2 Inference Shield for LLMs

easobel

SIMD-accelerated Sobel edge detection. 5-12x faster than OpenCV single-threaded.

pyflagstats

Efficient C functions to compute the summary statistics (flagstats) for sequencing read sets.

eavec

Fast vector similarity search. SIMD kernels via Eä, called from Python. Beats FAISS 4–8× at dim=384.