54 citations · 130 across the 13 of their papers we have counts for
5 papers · 1 filter
ACER: Automatic Language Model Context Extension via Retrieval
Luyu Gao, Yunyi Zhang, Jamie Callan
Long-context modeling is one of the critical capabilities of language AI for digesting and reasoning over complex information pieces. In practice, long-context capabilities are typ…
Active Retrieval Augmented Generation
Zhengbao Jiang, Frank F. Xu, Luyu Gao +6
Despite the remarkable ability of large language models (LMs) to comprehend and generate language, they have a tendency to hallucinate and create factually inaccurate output. Augme…
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
Zhengbao Jiang, Luyu Gao, Jun Araki +4
Systems for knowledge-intensive tasks such as open-domain question answering (QA) usually consist of two stages: efficient retrieval of relevant documents from a large corpus and d…
Condenser: a Pre-training Architecture for Dense Retrieval
Luyu Gao, Jamie Callan
Pre-trained Transformer language models (LM) have become go-to text representation encoders. Prior research fine-tunes deep LMs to encode text sequences such as sentences and passa…
Improving Target-side Lexical Transfer in Multilingual Neural Machine Translation
Luyu Gao, Xinyi Wang, Graham Neubig
To improve the performance of Neural Machine Translation~(NMT) for low-resource languages~(LRL), one effective strategy is to leverage parallel data from a related high-resource la…