ai-evaluation-framework
Comprehensive AI Model Evaluation Framework with advanced techniques including Temperature-Controlled Verdict Aggregation via Generalized Power Mean. Support for multiple LLM providers and 15+ evaluation metrics for RAG systems and AI agents.
An sdk and framework for evaluating and comparing multiple model outputs using configurable LLM-based jurors
Deterministic runtime for agent evaluation
Open-source AI model evaluation and benchmarking framework for LLMs (OpenAI, Ollama, Claude, Gemini)
