281 citations · 1.6k across the 109 of their papers we have counts for
4 papers · 1 filter
Controlling the Focus of Pretrained Language Generation Models
Jiabao Ji, Yoon Kim, James Glass +1
The finetuning of pretrained transformer-based language generation models are typically conducted in an end-to-end manner, where the model learns to attend to relevant parts of the…
An Empirical Study on Few-shot Knowledge Probing for Pretrained Language Models
Tianxing He, Kyunghyun Cho, James Glass
Prompt-based knowledge probing for 1-hop relations has been used to measure how much world knowledge is stored in pretrained language models. Existing work uses considerable amount…
Detecting egregious responses in neural sequence-to-sequence models
Tianxing He, James Glass
In this work, we attempt to answer a critical question: whether there exists some input sequence that will cause a well-trained discrete-space neural network sequence-to-sequence (…
Spoken Language Biomarkers for Detecting Cognitive Impairment
Tuka Alhanai, Rhoda Au, James Glass
In this study we developed an automated system that evaluates speech and language features from audio recordings of neuropsychological examinations of 92 subjects in the Framingham…