inspect harness benchmark (inspect_evals/aime2026)

Pallet Town starter + reach Viridian; fixed dialogue + seamless walk/transition + lean state payload (drops redundant collision grid) to keep SUT context small.

Long-form Pallet Town on NousResearch/pokemon-agent in Game Boy COLOR mode. Frames sampled at 0.5s and encoded to a film. Leave the house, get a starter, reach Viridian City; staged partial credit.

Harder Pallet Town screen-game task: leave the house, get a starter from Oak, and travel north through Route 1 to reach Viridian City (a strict superset of reach-oaks-lab).

Can the agent boot Link's Awakening (V1.2 U) from power-on and reach in-game play? Scored on wGameplayType phase reached.

An agentic terminal/CLI benchmark where each task is a containerized environment testing an agent's ability to operate a shell to solve real-world problems.