Towards Fine-Grained and Multi-Granular Contrastive Language-Speech Pre-training

Yifan Yang, Bing Han, Hui Wang +8

Modeling fine-grained speaking styles remains challenging for language-speech representation pre-training, as existing speech-text models are typically trained with coarse captions…