2026-09-23 · America/Los_Angeles · 论文 · #19

RoboFollow: Unveiling the Instruction Following Mirage in Embodied Agents

Modern embodied agents achieve impressive success rates, yet their actual instruction-following ability is far weaker than these numbers suggest. We trace this illusion to a structural property we term low scene entropy: when a visual scene admits only one valid task, language becomes redundant and a policy can score highly while barely using it. We introduce RoboFollow, a diagnostic benchmark with three principles: (1) High Scene Entropy: each training scene supports multiple kinematically distinct task branches, making vision alone insufficient and forcing reliance on language. (2)…

热度 33.9 / 100；排名与评分保留该期记录。