2026-10-01 · America/Los_Angeles · 论文 · #18

Thinking Outside the Box: Can Language Models Rely on External Guidance Selectively?

Agent harnesses often improve language models with human-designed workflows, but as models grow more capable, unreliable guidance can increasingly constrain their execution. We call the ability to benefit from useful guidance while overriding unreliable guidance thinking outside the box. We introduce Box^2-Bench, which holds the model and task fixed while varying workflow reliability to isolate how models regulate their reliance on guidance. On Box^2-Bench, frontier models often benefit from reliable guidance but remain vulnerable when it is misleading or becomes unreliable. To test whether…

热度 48.7 / 100；排名与评分保留该期记录。