1 citations · 2 across the 3 of their papers we have counts for
3 papers
KILM: Knowledge Injection into Encoder-Decoder Language Models
Yan Xu, Mahdi Namazifar, Devamanyu Hazarika +3
Large pre-trained language models (PLMs) have been shown to retain implicit knowledge within their parameters. To enhance this implicit knowledge, we propose Knowledge Injection in…
Role of Bias Terms in Dot-Product Attention
Mahdi Namazifar, Devamanyu Hazarika, Dilek Hakkani-Tur
Dot-product attention is a core module in the present generation of neural network models, particularly transformers, and is being leveraged across numerous areas such as natural l…
Selective In-Context Data Augmentation for Intent Detection using Pointwise V-Information
Yen-Ting Lin, Alexandros Papangelis, Seokhwan Kim +6
This work focuses on in-context data augmentation for intent detection. Having found that augmentation via in-context prompting of large pre-trained language models (PLMs) alone do…