Layer Reduction: Accelerating Conformer-Based Self-Supervised Model via Layer Consistency

Jinchuan Tian, Rongzhi Gu, Helin Wang +1

Transformer-based self-supervised models are trained as feature extractors and have empowered many downstream speech tasks to achieve state-of-the-art performance. However, both th…