2026-11-16 · America/Los_Angeles · 论文 · #8
Loopback Transformer: Towards a Unified View of Residual Looped Transformers
Looped Transformers reduce parameter count by repeatedly applying shared blocks, but parameter sharing alone does not determine how the results of repeated computation are reused. We take the depth-memory view of residual connections and analyze which representation is stored after each block application and how later reads weight it. A full block output contains both its input and its new update, so weighting that output also reweights the history already carried by the input. Reading individual updates instead, with the shared stack's input kept on a separate path, gives separate controls…
热度 45.2 / 100;排名与评分保留该期记录。