2026-11-01 · America/Los_Angeles · 论文 · #7

Breaking Information Islands in Sparse Tuning via Small-World Connectivity

Sparse tuning is widely used to adapt large language models due to its parameter efficiency. However, its effectiveness depends not only on the number of trainable parameters, but also on the feature-interaction topology of the sparse update's structural support. Limited or uneven connectivity in this support may isolate subsets of feature dimensions, forming information islands that restrict direct task-specific interactions through the trainable update. To address this issue, we propose Small-World Induced Fine-Tuning (SWIFT), a sparse tuning framework inspired by small-world connectivity.…

热度 14.0 / 100；排名与评分保留该期记录。