Human Bench

oooo                                                                     .o8                                       oooo        
`888                                                                    "888                                       `888        
 888 .oo.   oooo  oooo  ooo. .oo.  .oo.    .oooo.   ooo. .oo.            888oooo.   .ooooo.  ooo. .oo.    .ooooo.   888 .oo.   
 888P"Y88b  `888  `888  `888P"Y88bP"Y88b  `P  )88b  `888P"Y88b           d88' `88b d88' `88b `888P"Y88b  d88' `"Y8  888P"Y88b  
 888   888   888   888   888   888   888   .oP"888   888   888  8888888  888   888 888ooo888  888   888  888        888   888  
 888   888   888   888   888   888   888  d8(  888   888   888           888   888 888    .o  888   888  888   .o8  888   888  
o888o o888o  `V88V"V8P' o888o o888o o888o `Y888""8o o888o o888o          `Y8bod8P' `Y8bod8P' o888o o888o `Y8bod8P' o888o o888o

27 May

Experimenting on Agents

Zach Keller

Jun 18, 2026

Switching to a more powerful model did not make Righthand better at everyday work tasks

Jun 18, 2026

A more powerful model was slightly better at remembering what it had already been told

Jun 3, 2026

Experimenting on Agents

Switching to a more powerful model did not make Righthand better at everyday work tasks

A more powerful model was slightly better at remembering what it had already been told

A prompt meant to sharpen the assistant's judgment actually made it worse