Adaptive Dropout for Pruning Conformers

Yotaro Kubo, Xingyu Cai, Michiel Bacchiani

This paper proposes a method to effectively perform joint training-and-pruning based on adaptive dropout layers with unit-wise retention probabilities. The proposed method is based…