pydantic-evals
Pytest plugin that records, gates and tracks your LLM evals in the CI you already have.
Evaluate AI-generated SQL with pytest.
YAML Based Eval Specification Language and AI generation pipeline for LLMs and Developers.
A pytest plugin integrating pydantic-evals