3 papers
cs.SD2026
Masked Contrastive Pre-Training Improves Music Audio Key Detection
Ori Yonay, Tracy Hammond, Tianbao Yang
Self-supervised music foundation models underperform on key detection, which requires pitch-sensitive representations. In this work, we present the first systematic study showing t…
cs.SD2025
Myna: Masking-Based Contrastive Learning of Musical Representations
Ori Yonay, Tracy Hammond, Tianbao Yang
We present Myna, a simple yet effective approach for self-supervised musical representation learning. Built on a contrastive learning framework, Myna introduces two key innovations…
cs.LG2024
FastCLIP: A Suite of Optimization Techniques to Accelerate CLIP Training with Limited Resources
Xiyuan Wei, Fanjiang Ye, Ori Yonay +4
Existing studies of training state-of-the-art Contrastive Language-Image Pretraining (CLIP) models on large-scale data involve hundreds of or even thousands of GPUs due to the requ…