SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum
19 Oct 2026
Matryoshka Representation Learning (MRL) is designed to support flexible representation sizes by jointly optimizing nested prefixes. While effective, this design lacks an explicit constraint to ensure that the leading portion provides a suitable compact encoding.