Avx2 Python Packages

ctranslate2

Fast inference engine for Transformer models

pic-scale

High performance image scale in pure Rust

turbocpp

Fast CPU LLM inference in pure C++17. AVX2+FMA matmul, Q4/Q8 quantization, TurboQuant-style 4/3-bit KV cache, GQA, BPE, mmap loader. Zero deps.

corrfunc

⚡️⚡️⚡️Blazing fast correlation functions on the CPU.

osaca

Open Source Architecture Code Analyzer

ctranslate2-arty

Fast inference engine for Transformer models

detect-simd

Python library to detect CPU SIMD capabilities.

eastat

CSV column statistics powered by Ea SIMD kernels.

ea-compiler

Eä compute kernel compiler for Python — write SIMD kernels, call from NumPy

residue-protocol

Bare-Metal AVX2 Inference Shield for LLMs

eavec

SIMD-accelerated vector similarity search. 3-4x faster than FAISS at dim=384.

easobel

SIMD-accelerated Sobel edge detection. 5-12x faster than OpenCV single-threaded.

pyflagstats

Efficient C functions to compute the summary statistics (flagstats) for sequencing read sets.

adaptq

High-performance CPU KV-cache quantization engine for LLM inference (~10× speedup, 4× memory reduction) with Python & PyTorch support.