2026-11-12 · America/Los_Angeles · 论文 · #8
Where Does Alignment Emerge and What Does It Mean? A Closer Look at the Platonic Representation Hypothesis
The Platonic Representation Hypothesis (PRH) suggests that neural networks are converging toward similar representation spaces. As language models become more capable, their representations are aligning with those of vision models. However, recent work has questioned whether this trend continues to hold for newer language models. Moreover, it has been shown that representation similarity metrics can be confounded by model depth and width, requiring appropriate baselines for interpretation. In this work, we first investigate where alignment emerges between unimodal models across model layers…
热度 34.2 / 100;排名与评分保留该期记录。