Learning Contextually Fused Audio-visual Representations for Audio-visual Speech Recognition

Zi-Qiang Zhang, Jie Zhang, Jian-Shu Zhang +3

With the advance in self-supervised learning for audio and visual modalities, it has become possible to learn a robust audio-visual speech representation. This would be beneficial…