2026-10-14 · America/Los_Angeles · 论文 · #12

AReA: Adaptive Receptive-Field Attention for Efficient High-Resolution Diffusion Transformers

Generating images beyond the training resolution of Diffusion Transformers (DiTs) remains challenging, as the number of tokens grows rapidly with resolution, full attention becomes expensive, and outputs often suffer from structural distortions and degraded detail. We identify uniform full attention as the common source of both problems. Attending to all tokens at every step causes quadratic cost and exposes the model to more tokens and relative distances beyond the training range, pushing the model out of distribution. We observe that attention's effective receptive field narrows during…

热度 53.4 / 100；排名与评分保留该期记录。