inference-time-compute
Inference-time scaling for LLMs-as-a-judge.
Best-of-N 1.1 — sample a frozen language model N times and select the best answer. 45.3% to 66.5% on GSM8K with a 0.5B model, no training. Eight models measured, all 25,600 trajectories published.
