DoubleHelix: Structured Cross-Modal Fusion for Audio-Visual Speech Recognition with LLMs

Ziwei Cheng, Zhenhua Tan, Zhuomin Zhu

Audio-visual speech recognition (AVSR) relies on effective fusion of audio and visual modalities, yet existing approaches treat cross-modal interaction as a single-step operation w…