33 citations · 98 across the 17 of their papers we have counts for
Showing 2020Show all
3 papers · 1 filter
cs.CL2020★ 5 cited
Dirichlet-Smoothed Word Embeddings for Low-Resource Settings
Jakob Jungmaier, Nora Kassner, Benjamin Roth
Nowadays, classical count-based word embeddings using positive pointwise mutual information (PPMI) weighted co-occurrence matrices have been widely superseded by machine-learning-b…
cs.CL2020
Are Pretrained Language Models Symbolic Reasoners Over Knowledge?
Nora Kassner, Benno Krojer, Hinrich Schütze
How can pretrained language models (PLMs) learn factual knowledge from the training set? We investigate the two most important mechanisms: reasoning and memorization. Prior work ha…
cs.CL2020
BERT-kNN: Adding a kNN Search Component to Pretrained Language Models for Better QA
Nora Kassner, Hinrich Schütze
Khandelwal et al. (2020) use a k-nearest-neighbor (kNN) component to improve language model performance. We show that this idea is beneficial for open-domain question answering (QA…