18 citations · 35 across the 3 of their papers we have counts for
3 papers
cs.CL2023★ 2 cited
Tuning Large language model for End-to-end Speech Translation
Hao Zhang, Nianwen Si, Yaqi Chen +4
With the emergence of large language models (LLMs), multimodal models based on LLMs have demonstrated significant potential. Models such as LLaSM, X-LLM, and SpeechGPT exhibit an i…
cs.CL2023★ 15 cited
DropDim: A Regularization Method for Transformer Networks
Hao Zhang, Dan Qu, Keji Shao +1
We introduceDropDim, a structured dropout method designed for regularizing the self-attention mechanism, which is a key component of the transformer. In contrast to the general dro…
cs.CL2023★ 18 cited
Improving Speech Translation by Cross-Modal Multi-Grained Contrastive Learning
Hao Zhang, Nianwen Si, Yaqi Chen +4
The end-to-end speech translation (E2E-ST) model has gradually become a mainstream paradigm due to its low latency and less error propagation. However, it is non-trivial to train s…