judge
CYaRon: Yet Another Random Olympic-iNformatics test data generator
Production-grade Python framework for evaluating LLM and agentic systems with traditional scorers, LLM judges (OpenAI, Anthropic, Ollama, 100+ models via LiteLLM), ensemble aggregation, and smart caching for cost-effective testing.
judge the program locally
BOJ-Offline-Judge는 백준 온라인 저지를 CLI, 혹은 Python 스크립트를 통해 이용 하기 위해 제작한 API 입니다.
Judge and evaluate your chunk quality with Judie, the Owl! Quick, easy, and effective!
The chunking benchmark