2 citations · 2 across the 6 of their papers we have counts for
6 papers
Rethinking Length-Based Training: Batch Composition and Loss Normalization in Speech Token Language Models
Hongjin Song, Runwu Shi, Weiqiao Shan +4
Short-to-long training is a simple curriculum for speech models, but its gains can be difficult to interpret. In speech token language models, length-based training can change the…
Joint Residual Reweighting for Classifier Free Guidance in Flow-Matching Zero-Shot TTS
Runwu Shi, Yujin Wang, Hongjin Song +8
Classifier-free guidance (CFG) is widely used in flow-matching-based zero-shot text-to-speech (TTS), where generation is conditioned on text content and a speech prompt. Standard C…
Front-End Adapter: Adapting Front-End Input of Speech based Self-Supervised Learning for Speech Recognition
Xie Chen, Ziyang Ma, Changli Tang +2
Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL models present promising performance in a range…
Exploring Effective Fusion Algorithms for Speech Based Self-Supervised Learning Models
Changli Tang, Yujin Wang, Xie Chen +1
Self-supervised learning (SSL) has achieved great success in various areas including speech processing. Recently, it is proven that speech based SSL models are able to extract supe…
MT4SSL: Boosting Self-Supervised Speech Representation Learning by Integrating Multiple Targets
Ziyang Ma, Zhisheng Zheng, Changli Tang +2
In this paper, we provide a new perspective on self-supervised speech models from how the training targets are obtained. We generalize the targets extractor into Offline Targets Ex…
Exploring Effective Distillation of Self-Supervised Speech Models for Automatic Speech Recognition
Yujin Wang, Changli Tang, Ziyang Ma +3
Recent years have witnessed great strides in self-supervised learning (SSL) on the speech processing. The SSL model is normally pre-trained on a great variety of unlabelled data an…