60 citations · 279 across the 19 of their papers we have counts for
4 papers · 1 filter
The Effect of Masking Strategies on Knowledge Retention by Language Models
Jonas Wallat, Tianyi Zhang, Avishek Anand
Language models retain a significant amount of world knowledge from their pre-training stage. This allows knowledgeable models to be applied to knowledge-intensive tasks prevalent…
BERTnesia: Investigating the capture and forgetting of knowledge in BERT
Jonas Wallat, Jaspreet Singh, Avishek Anand
Probing complex language models has recently revealed several insights into linguistic and semantic patterns found in the learned representations. In this article, we probe BERT sp…
BERTnesia: Investigating the capture and forgetting of knowledge in BERT
Jonas Wallat, Jaspreet Singh, Avishek Anand
Probing complex language models has recently revealed several insights into linguistic and semantic patterns found in the learned representations. In this paper, we probe BERT spec…
Fine Grained Citation Span for References in Wikipedia
Besnik Fetahu, Katja Markert, Avishek Anand
\emph{Verifiability} is one of the core editing principles in Wikipedia, editors being encouraged to provide citations for the added content. For a Wikipedia article, determining t…