AI Resonance · 阅读最新日报 · AI 入门推荐

2026-11-16 · America/Los_Angeles · 论文 · #8

Loopback Transformer: Towards a Unified View of Residual Looped Transformers

Looped Transformers reduce parameter count by repeatedly applying shared blocks, but parameter sharing alone does not determine how the results of repeated computation are reused. We take the depth-memory view of residual connections and analyze which representation is stored after each block application and how later reads weight it. A full block output contains both its input and its new update, so weighting that output also reweights the history already carried by the input. Reading individual updates instead, with the shared stack's input kept on a separate path, gives separate controls…

Loopback Transformer: Towards a Unified View of Residual Looped Transformers

热度 45.2 / 100;排名与评分保留该期记录。