Audio-visual fine-tuning of audio-only ASR models

Avner May, Dmitriy Serdyuk, Ankit Parag Shah +2

Audio-visual automatic speech recognition (AV-ASR) models are very effective at reducing word error rates on noisy speech, but require large amounts of transcribed AV training data…