Behavioral Testing Python Packages

gauntlet-cli

Community-driven behavioral reliability benchmark for LLMs. 231 probes across 19 modules, deterministic scoring, perplexity correlation, layer sensitivity mapping, quant method capture, hardware-stratified community rankings. Every test contributes to the community dataset.

agentassert-abc

Formal behavioral specification and runtime enforcement for autonomous AI agents. Agent Behavioral Contracts (ABC).

modeldiffx

Behavioral regression testing for LLMs. Capture outputs, diff behavior, detect drift — pytest for model upgrades.

llm-behave

Behavioral testing for LLM applications. pytest plugin with semantic assertions, multi-turn conversation testing, and drift detection. No LLM judge needed.

specterqa

AI persona-based behavioral testing for web apps. No test scripts. YAML-configured. Vision-powered.

trajex

AI agent behavioral testing — learns what correct looks like, catches deviations automatically. Zero API keys needed.

ghostqa

AI persona-based behavioral testing for web apps. No test scripts. YAML-configured. Vision-powered.