Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Identifying Crucial Attention Heads for Multilingual Language Models: Retrieval and Retrieval-Transition Heads
Shaswat Patel, Vishvesh Trivedi, Yue Han +2
Retrieval heads, a subset of attention heads in Transformers, were studied in English, showing its crucial role in retrieving information from the context. We expand the study of r…
cs.CL2022
Rumour detection using graph neural network and oversampling in benchmark Twitter dataset
Shaswat Patel, Prince Bansal, Preeti Kaur
Recently, online social media has become a primary source for new information and misinformation or rumours. In the absence of an automatic rumour detection system the propagation…