Showing 2025Show all
3 papers · 1 filter
cs.LG2025
NeuCLIP: Efficient Large-Scale CLIP Training with Neural Normalizer Optimization
Xiyuan Wei, Chih-Jen Lin, Tianbao Yang
Accurately estimating the normalization term (also known as the partition function) in the contrastive loss is a central challenge for training Contrastive Language-Image Pre-train…
cs.LG2025
Model Steering: Learning with a Reference Model Improves Generalization Bounds and Scaling Laws
Xiyuan Wei, Ming Lin, Fanjiang Ye +4
This paper formalizes an emerging learning paradigm that uses a trained model as a reference to guide and enhance the training of a target model through strategic data selection or…
cs.SD2025
Myna: Masking-Based Contrastive Learning of Musical Representations
Ori Yonay, Tracy Hammond, Tianbao Yang
We present Myna, a simple yet effective approach for self-supervised musical representation learning. Built on a contrastive learning framework, Myna introduces two key innovations…