2026-10-20 · America/Los_Angeles · 论文 · #8

SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum

Matryoshka Representation Learning (MRL) is designed to support flexible representation sizes by jointly optimizing nested prefixes. While effective, this design lacks an explicit constraint to ensure that the leading portion provides a suitable compact encoding. To address this, we propose SpecMRL, which reorganizes the feature space to enable more effective prefix readout. Specifically, we extend MRL with a parameter-derived spectral basis organized with feature importance. SpecMRL otherwise follows standard MRL, with prefix readout performed in the learned spectral space. Experiments on…

热度 55.0 / 100；排名与评分保留该期记录。