5 papers
Collapse, Repair, and Drift: Dissecting Fine Tuning Dynamics in Speech Language Models
Yichi Wang, Wangjin Zhou, Yizhou Zhang +4
Supervised fine tuning (SFT) is commonly monitored through training and evaluation loss, but loss does not fully characterize how model functionality evolves along the same traject…
Direct or Mediated? Task-Dependent Audio Information Routing in Large Audio Language Models
Yizhou Zhang, Wangjin Zhou, Xin Gu +6
Large Audio Language Models (LALMs) have demonstrated strong performance across a wide range of audio understanding tasks. However, they are typically evaluated on single, coherent…
Rethinking Speech Foundation Model Fine-tuning: Better SFT or Better Match?
Wangjin Zhou, Yizhou Zhang, Yichi Wang +1
Supervised fine-tuning (SFT) is widely used to adapt self-supervised speech representations to downstream classification tasks. Small gains observed under a single pretrained check…
Position-Aware Target Speaker Extraction for Long-Form Multi-Party Conversations: A Diarization-Free Framework for ASR
Yichi Wang, Junzhe Chen, Wangjin Zhou +1
In long-form multi-party conversations, highly imbalanced speaker activity and frequent overlap make it difficult to identify "who spoke when and what". Sliding-window continuous s…
The USTC-NERCSLIP Systems for The ICMC-ASR Challenge
Minghui Wu, Luzhen Xu, Jie Zhang +15
This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlappin…