Drowning in Noise: On Signal Saliency in Self-Supervised Learning for Ocean Acoustics

Shikhar Bharadwaj, Samuele Cornell, Shinji Watanabe +1

Self-supervised learning (SSL) for audio typically benefits from larger pre-training corpora, but this relationship assumes that training data carries meaningful learning signal. I…