gsm8k
Best-of-N 1.1 — sample a frozen language model N times and select the best answer. 45.3% to 66.5% on GSM8K with a 0.5B model, no training. Eight models measured, all 25,600 trajectories published.
A pip-installable benchmark runner for LLMs and agents. Five minutes to your first eval.
