2026-11-12 · America/Los_Angeles · 论文 · #10

WMIP: A Working-Memory-Inspired Programmable Probe of Cumulative State Tracking in Large Language Models

Human working memory lets people maintain and update information. Large language models (LLMs) face a related demand when tracking updates within a single prompt without writing out intermediate states, yet existing tests differ in their constraints on written steps. We introduce a working-memory-inspired probe of cumulative state tracking with program-computed answers, 3 to 100 updates, and final-state, intermediate-state, or multi-target queries. It compares protocols on identical items. Across 18 LLMs, accuracy is 84.9% on single-step arithmetic but 31.7% on core items requiring one…

热度 30.1 / 100；排名与评分保留该期记录。