llm-evaluation-metrics
The LLM Evaluation Framework
Agent Behavior Specification — describe, run, and evaluate AI agent interactions from the command line
LangFair is a Python library for conducting use-case level LLM bias and fairness assessments
Tools for systematic large language model evaluations
CRUS-T: a normalized, programmatically computable runtime reliability score for agentic AI, per Ghosh Dastidar, 'Proportionate Governance in Practice'.
