activity
20142023
most citedUnified Language Model Pre-training for Natural Language Understanding and Generation

941 citations · 2.5k across the 22 of their papers we have counts for

collaborators

22 papers

cs.CL2023★ 13 cited

Learning to Retrieve In-Context Examples for Large Language Models

Liang Wang, Nan Yang, Furu Wei

Large language models (LLMs) have demonstrated their ability to learn in-context, allowing them to perform various tasks based on a few input-output examples. However, the effectiv…

cs.CL2023★ 3 cited

Learning to Rank in Generative Retrieval

Yongqi Li, Nan Yang, Liang Wang +2

Generative retrieval stands out as a promising new paradigm in text retrieval that aims to generate identifier strings of relevant passages as the retrieval target. This generative…

cs.CL2023★ 4 cited

Multiview Identifiers Enhanced Generative Retrieval

Yongqi Li, Nan Yang, Liang Wang +2

Instead of simply matching a query to pre-existing passages, generative retrieval generates identifier strings of passages as the retrieval target. At a cost, the identifier must b…

cs.CL2023★ 14 cited

Inference with Reference: Lossless Acceleration of Large Language Models

Nan Yang, Tao Ge, Liang Wang +5

We propose LLMA, an LLM accelerator to losslessly speed up Large Language Model (LLM) inference with references. LLMA is motivated by the observation that there are abundant identi…

cs.IR2023★ 6 cited

Query2doc: Query Expansion with Large Language Models

Liang Wang, Nan Yang, Furu Wei

This paper introduces a simple yet effective query expansion approach, denoted as query2doc, to improve both sparse and dense retrieval systems. The proposed method first generates…

cs.CL2022★ 123 cited

Text Embeddings by Weakly-Supervised Contrastive Pre-training

Liang Wang, Nan Yang, Xiaolong Huang +5

This paper presents E5, a family of state-of-the-art text embeddings that transfer well to a wide range of tasks. The model is trained in a contrastive manner with weak supervision…