Problems.
Write the piece, drive the whole agent loop, or repair a repo by prompting a coding agent. Most are graded against a real model, because that is what you will ship against.
0 of 85 solved
Show me at , . 6 matches
- 16Score an Answer with an LLM Judgeimplement · liveagent · liveL07medium
- 27Score a Model Against a Golden Setimplement · liveagent · liveL07medium
- 41Catch the Regression Between Two VersionsimplementstdlibL07medium
- 43Write the Tests That Catch the Bugwrite testsstdlibL07medium
- 45Find the First Turn That Went WrongimplementagentL07medium
- 46Detect an Agent Stuck in a Loopagent loopagentL07medium
6 of 85 problems