2026-11-09 · America/Los_Angeles · 社区动态 · #11

I tried to reproduce “lost in the middle” on current models and actually couldn’t do that! [P]

Everyone keeps citing lost in the middle so, instead of going by the paper's citations, i wanted to actually check it on my own stuff, without building a labeled set for it. So i did the lazy version. make up facts the model can’t already know, drop the one document that has the answer into a pile of distractor documents, and slide that doc through every position (front, middle, back), asking the question each time. if the answer changes depending on where the doc sits, that’s position sensitivity. no ground truth needed, just checking it doesn’t contradict itself. ran it on haiku 4.5 and…

热度 40.0 / 100；排名与评分保留该期记录。