12 citations · 19 across the 5 of their papers we have counts for
5 papers
SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models
Xin Zhang, Dong Zhang, Shimin Li +2
Current speech large language models build upon discrete speech representations, which can be categorized into semantic tokens and acoustic tokens. However, existing speech tokens…
Multijugate Dual Learning for Low-Resource Task-Oriented Dialogue System
Shimin Li, Xiaotian Zhang, Yanjun Zheng +2
Dialogue data in real scenarios tend to be sparsely available, rendering data-starved end-to-end dialogue systems trained inadequately. We discover that data utilization efficiency…
SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities
Dong Zhang, Shimin Li, Xin Zhang +4
Multi-modal large language models are regarded as a crucial step towards Artificial General Intelligence (AGI) and have garnered significant interest with the emergence of ChatGPT.…
Mitigating Negative Style Transfer in Hybrid Dialogue System
Shimin Li, Qinyuan Cheng, Linyang Li +1
As the functionality of dialogue systems evolves, hybrid dialogue systems that accomplish user-specific goals and participate in open-topic chitchat with users are attracting growi…
Contrast and Generation Make BART a Good Dialogue Emotion Recognizer
Shimin Li, Hang Yan, Xipeng Qiu
In dialogue systems, utterances with similar semantics may have distinctive emotions under different contexts. Therefore, modeling long-range contextual emotional relationships wit…