3 papers
cs.LG2024
AdaPTwin: Low-Cost Adaptive Compression of Product Twins in Transformers
Emil Biju, Anirudh Sriram, Mert Pilanci
While large transformer-based models have exhibited remarkable performance in speaker-independent speech recognition, their large size and computational requirements make them expe…
cs.LG2022
Joint Transformer/RNN Architecture for Gesture Typing in Indic Languages
Emil Biju, Anirudh Sriram, Mitesh M. Khapra +1
Gesture typing is a method of typing words on a touch-based keyboard by creating a continuous trace passing through the relevant keys. This work is aimed at developing a keyboard t…
cs.CL2022
Input-specific Attention Subnetworks for Adversarial Detection
Emil Biju, Anirudh Sriram, Pratyush Kumar +1
Self-attention heads are characteristic of Transformer models and have been well studied for interpretability and pruning. In this work, we demonstrate an altogether different util…