From Hype to Insight: Rethinking Large Language Model Integration in Visual Speech Recognition

Rishabh Jain, Naomi Harte

Advances in self-supervised encoders have improved Visual Speech Recognition (VSR). Recent approaches integrating these encoders with LLM decoders improves transcription accuracy;…