1.5k citations · 3.4k across the 33 of their papers we have counts for
35 papers
Triggering Multi-Hop Reasoning for Question Answering in Language Models using Soft Prompts and Random Walks
Kanishka Misra, Cicero Nogueira dos Santos, Siamak Shakeri
Despite readily memorizing world knowledge about entities, pre-trained language models (LMs) struggle to compose together two or more facts to perform multi-hop reasoning in questi…
Knowledge Prompts: Injecting World Knowledge into Language Models through Soft Prompts
Cicero Nogueira dos Santos, Zhe Dong, Daniel Cer +4
Soft prompts have been recently proposed as a tool for adapting large frozen language models (LMs) to new tasks. In this work, we repurpose soft prompts to the task of injecting wo…
Counterfactual Data Augmentation improves Factuality of Abstractive Summarization
Dheeraj Rajagopal, Siamak Shakeri, Cicero Nogueira dos Santos +2
Abstractive summarization systems based on pretrained language models often generate coherent but factually inconsistent sentences. In this paper, we present a counterfactual data…
ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference
Kai Hui, Honglei Zhuang, Tao Chen +8
State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradig…
Contrastive Fine-tuning Improves Robustness for Neural Rankers
Xiaofei Ma, Cicero Nogueira dos Santos, Andrew O. Arnold
The performance of state-of-the-art neural rankers can deteriorate substantially when exposed to noisy inputs or applied to a new domain. In this paper, we present a novel method f…
Joint Text and Label Generation for Spoken Language Understanding
Yang Li, Ben Athiwaratkun, Cicero Nogueira dos Santos +1
Generalization is a central problem in machine learning, especially when data is limited. Using prior information to enforce constraints is the principled way of encouraging genera…