swebench
An AI coding agent that fixes real GitHub bugs, and a lab that measures how well it does it: graded by hidden tests, every run replayable.