Agent Testing Python Packages

langwatch-scenario

Agentic testing for agentic codebases

mcp-wallfacer

Runtime fuzzing and invariant-testing harness for MCP servers.

agentbreak

infrastructure chaos to test the resilience of ai agents

volnix

A living world where agents exist as participants alongside NPCs, internal actors, real service APIs, budgets, policies, and consequences.

agentassay

Token-efficient stochastic testing for AI agents. 5-20x cost reduction. 10 framework adapters. Paper: arXiv:2603.02601

agentverify

pytest plugin for deterministic testing of AI agents. Assert agent actions, not vibes.

tracecore

Deterministic runtime for agent evaluation

agentos-platform

"The Operating System for AI Agents. Build, Test, Deploy, Monitor, Govern."

tddf

Behaviour regression tests for AI agents — deterministic, local-first, no LLM-as-judge

toolcallcheck

Deterministic Python testing for tool-using agents. Mock MCP tools, assert exact tool calls and trajectories, verify headers, and run offline in CI.