652 citations · 1.7k across the 25 of their papers we have counts for
4 papers · 1 filter
Beyond [CLS] through Ranking by Generation
Cicero Nogueira dos Santos, Xiaofei Ma, Ramesh Nallapati +2
Generative models for Information Retrieval, where ranking of documents is viewed as the task of generating a query from a document's language model, were very successful in variou…
Improve Transformer Models with Better Relative Position Embeddings
Zhiheng Huang, Davis Liang, Peng Xu +1
Transformer architectures rely on explicit position encodings in order to preserve a notion of word order. In this paper, we argue that existing work does not fully utilize positio…
Embedding-based Zero-shot Retrieval through Query Generation
Davis Liang, Peng Xu, Siamak Shakeri +4
Passage retrieval addresses the problem of locating relevant passages, usually from a large corpus, given a query. In practice, lexical term-matching algorithms like BM25 are popul…
TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding
Zhiheng Huang, Peng Xu, Davis Liang +2
Bidirectional Encoder Representations from Transformers (BERT) has recently achieved state-of-the-art performance on a broad range of NLP tasks including sentence classification, m…