2026-11-12 · America/Los_Angeles · 论文 · #11

CogBattery: Human-Referenced Evaluation of Cognitive Task Behavior and Structure in Language Models

Human cognitive tasks let us compare language models with humans under controlled conditions. Yet a model can reproduce the direction of a human effect while making different errors. CogBattery evaluates 54 open-weight language models on text adaptations of 13 cognitive paradigms, comparing each with human data from its source study. Like humans, models respond more to n-back lures than to controls, yet they make far more false alarms on ordinary non-targets. Most models' reported confidence separates correct from incorrect answers less well than humans' does, and most always choose the same…

热度 30.1 / 100；排名与评分保留该期记录。