61 citations · 116 across the 15 of their papers we have counts for
3 papers · 2 filters
OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languages
Prem Selvaraj, Gokul NC, Pratyush Kumar +1
AI technologies for Natural Languages have made tremendous progress recently. However, commensurate progress has not been made on Sign Languages, in particular, in recognizing sign…
On the Prunability of Attention Heads in Multilingual BERT
Aakriti Budhraja, Madhura Pande, Pratyush Kumar +1
Large multilingual models, such as mBERT, have shown promise in crosslingual transfer. In this work, we employ pruning to quantify the robustness and interpret layer-wise importanc…
The heads hypothesis: A unifying statistical approach towards understanding multi-headed attention in BERT
Madhura Pande, Aakriti Budhraja, Preksha Nema +2
Multi-headed attention heads are a mainstay in transformer-based models. Different methods have been proposed to classify the role of each attention head based on the relations bet…