llms-benchmarking
Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)
Framework for benchmarking and analyzing LLMs on simple games
Develop reliable AI apps
GenderBench - Evaluation suite for gender biases in LLMs
needle in a haystack for LLMs