Mitigating Attention Sinks and Massive Activations in Audio-Visual Speech Recognition with LLMs

Anand, Umberto Cappellazzo, Stavros Petridis +1

Large language models (LLMs) have recently advanced auditory speech recognition (ASR), visual speech recognition (VSR), and audio-visual speech recognition (AVSR). However, underst…