2 papers
cs.LG2025
Eigenfunction Extraction for Ordered Representation Learning
Burak Varıcı, Che-Ping Tsai, Ritabrata Ray +2
Recent advances in representation learning reveal that widely used objectives, such as contrastive and non-contrastive, implicitly perform spectral decomposition of a contextual ke…
cs.LG2025
Contextures: Representations from Contexts
Runtian Zhai, Kai Yang, Che-Ping Tsai +3
Despite the empirical success of foundation models, we do not have a systematic characterization of the representations that these models learn. In this paper, we establish the con…