18 citations · 44 across the 10 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
eess.AS2022★ 1 cited
Conformer with dual-mode chunked attention for joint online and offline ASR
Felix Weninger, Marco Gaudesi, Md Akmal Haidar +3
In this paper, we present an in-depth study on online attention mechanisms and distillation techniques for dual-mode (i.e., joint online and offline) ASR using the Conformer Transd…
cs.CL2022★ 3 cited
CILDA: Contrastive Data Augmentation using Intermediate Layer Knowledge Distillation
Md Akmal Haidar, Mehdi Rezagholizadeh, Abbas Ghaddar +3
Knowledge distillation (KD) is an efficient framework for compressing large-scale pre-trained language models. Recent years have seen a surge of research aiming to improve KD by le…