Llms Benchmarking Python Packages

parea-ai

Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

multinear

Develop reliable AI apps

genderbench

Evaluation suite for gender biases in LLMs.

liah

Insert a Lie in a Haystack and evaluate the model's ability to detect it.

gender-bench

GenderBench - Evaluation suite for gender biases in LLMs