AdaPTwin: Low-Cost Adaptive Compression of Product Twins in Transformers

Emil Biju, Anirudh Sriram, Mert Pilanci

While large transformer-based models have exhibited remarkable performance in speaker-independent speech recognition, their large size and computational requirements make them expe…