Ci Gate Python Packages

gauntlet-evals

pip install gauntlet-evals · v0.1.0. Merge-blocking evaluation gates for generative AI features: YAML suites run against any HTTP endpoint or Python callable, fail the build on a miss, and emit both a diffable JSON pack and a reviewer document cross-referenced to California's published GenAI risk framework. Aligned to, never approved by.

clef-evals

Calibration-first evaluation toolkit for Cloudflare's Clef decision models. Judge cheap, audit confidence.

coldpath

Prove whether an Arm binary can actually use the chip's matrix hardware. Static ISA verifier + CI gate for AArch64 AI runtimes (SME/SME2, i8mm, dotprod).

hemlock-rag

Complete security framework for AI Agents, MCP Servers, and RAG pipelines. Features automated MCP fuzzing, cross-agent poisoning detection, persistent memory audits, unified risk scoring, and CI/CD security gates.