26 citations · 32 across the 9 of their papers we have counts for
10 papers
Full-Duplex Speech Models Take the Floor When Asked, Not When Needed
Linkai Peng, Baorian Nuchged, Kaiqi Fu +1
Full-duplex speech models listen and speak at once, promising always-on assistants. Yet they must also decide when they should speak. Human listeners speak when addressed or when t…
X2-NativeCursor: Native-Token Text Progress Tracking for Incremental-Text Streaming Codec TTS
Zehan Liu, Carl Chen, Rime Wen +7
Incremental-text streaming text-to-speech (TTS) needs online text progress tracking for synchronized highlighting, interruption handling, and dialogue-history updates. Input text a…
X2Streaming-ASR: wait when uncertain, emit when ready for streaming ASR
Zhiwei Lin, Kaiqi Fu, Rime Wen +5
Streaming automatic speech recognition (ASR) for real-time voice agents and full-duplex dialogue must provide accurate partial transcripts with low commit latency. Existing systems…
X2-Turn: Frame-Synchronous Dual-Head Modeling for Joint Streaming ASR and Turn State Prediction
Kaiqi Fu, Rime Wen, Altman Lin +4
Accurate and responsive turn-taking is essential for spoken dialogue systems, which must distinguish in real time between user interruptions, backchannels that should be ignored, a…
Pronunciation Assessment with Multi-modal Large Language Models
Kaiqi Fu, Linkai Peng, Nan Yang +1
Large language models (LLMs), renowned for their powerful conversational abilities, are widely recognized as exceptional tools in the field of education, particularly in the contex…
Phonetic and Prosody-aware Self-supervised Learning Approach for Non-native Fluency Scoring
Kaiqi Fu, Shaojun Gao, Shuju Shi +3
Speech fluency/disfluency can be evaluated by analyzing a range of phonetic and prosodic features. Deep neural networks are commonly trained to map fluency-related features into th…
Leveraging phone-level linguistic-acoustic similarity for utterance-level pronunciation scoring
Wei Liu, Kaiqi Fu, Xiaohai Tian +4
Recent studies on pronunciation scoring have explored the effect of introducing phone embeddings as reference pronunciation, but mostly in an implicit manner, i.e., addition or con…
An ASR-free Fluency Scoring Approach with Self-Supervised Learning
Wei Liu, Kaiqi Fu, Xiaohai Tian +4
A typical fluency scoring system generally relies on an automatic speech recognition (ASR) system to obtain time stamps in input speech for either the subsequent calculation of flu…
Improving Non-native Word-level Pronunciation Scoring with Phone-level Mixup Data Augmentation and Multi-source Information
Kaiqi Fu, Shaojun Gao, Kai Wang +3
Deep learning-based pronunciation scoring models highly rely on the availability of the annotated non-native data, which is costly and has scalability issues. To deal with the data…
A Full Text-Dependent End to End Mispronunciation Detection and Diagnosis with Easy Data Augmentation Techniques
Kaiqi Fu, Jones Lin, Dengfeng Ke +3
Recently, end-to-end mispronunciation detection and diagnosis (MD&D) systems has become a popular alternative to greatly simplify the model-building process of conventional hybrid…