Cross-Modal Bottleneck Fusion For Noise Robust Audio-Visual Speech Recognition

Seaone Ok, Min Jun Choi, Eungbeom Kim +2

Audio-Visual Speech Recognition (AVSR) leverages both acoustic and visual cues to improve speech recognition under noisy conditions. A central question is how to design a fusion me…