activity
20172026
most citedA Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models

57 citations · 253 across the 33 of their papers we have counts for

collaborators
Showing cs.IRShow all

20 papers · 1 filter

cs.IR2026

Retrieval Augmented Conversational Recommendation with Reinforcement Learning

Zhenrui Yue, Honglei Zhuang, Zhen Qin +4

Large language models (LLMs) exhibit enhanced capabilities in language understanding and generation. By utilizing their embedded knowledge, LLMs are increasingly used as conversati…

cs.IR2025

Harnessing Pairwise Ranking Prompting Through Sample-Efficient Ranking Distillation

Junru Wu, Le Yan, Zhen Qin +6

While Pairwise Ranking Prompting (PRP) with Large Language Models (LLMs) is one of the most effective zero-shot document ranking methods, it has a quadratic computational complexit…

cs.IR2024

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

Le Yan, Zhen Qin, Honglei Zhuang +4

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly askin…

cs.IR2024★ 1 cited

MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers

Fang Guo, Wenyu Li, Honglei Zhuang +5

The most recent pointwise Large Language Model (LLM) rankers have achieved remarkable ranking results. However, these rankers are hindered by two major drawbacks: (1) they fail to…

cs.IR2023★ 13 cited

Can Query Expansion Improve Generalization of Strong Cross-Encoder Rankers?

Minghan Li, Honglei Zhuang, Kai Hui +5

Query expansion has been widely used to improve the search results of first-stage retrievers, yet its influence on second-stage, cross-encoder rankers remains under-explored. A rec…

cs.IR2023★ 2 cited

PaRaDe: Passage Ranking using Demonstrations with Large Language Models

Andrew Drozdov, Honglei Zhuang, Zhuyun Dai +8

Recent studies show that large language models (LLMs) can be instructed to effectively perform zero-shot passage re-ranking, in which the results of a first stage retrieval method,…

cs.IR2023★ 7 cited

Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels

Honglei Zhuang, Zhen Qin, Kai Hui +4

Zero-shot text rankers powered by recent LLMs achieve remarkable ranking performance by simply prompting. Existing prompts for pointwise LLM rankers mostly ask the model to choose…

cs.IR2023★ 57 cited

A Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models

Shengyao Zhuang, Honglei Zhuang, Bevan Koopman +1

We propose a novel zero-shot document ranking approach based on Large Language Models (LLMs): the Setwise prompting approach. Our approach complements existing prompting approaches…

cs.IR2023★ 1 cited

RD-Suite: A Benchmark for Ranking Distillation

Zhen Qin, Rolf Jagerman, Rama Pasumarthi +6

The distillation of ranking models has become an important topic in both academia and industry. In recent years, several advanced methods have been proposed to tackle this problem,…

cs.IR2023★ 19 cited

Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting

Zhen Qin, Rolf Jagerman, Kai Hui +9

Ranking documents using Large Language Models (LLMs) by directly feeding the query and candidate documents into the prompt is an interesting and practical problem. However, researc…

cs.IR2023★ 3 cited

How Does Generative Retrieval Scale to Millions of Passages?

Ronak Pradeep, Kai Hui, Jai Gupta +5

Popularized by the Differentiable Search Index, the emerging paradigm of generative retrieval re-frames the classic information retrieval problem into a sequence-to-sequence modeli…

cs.IR2023★ 20 cited

Query Expansion by Prompting Large Language Models

Rolf Jagerman, Honglei Zhuang, Zhen Qin +2

Query expansion is a widely used technique to improve the recall of search systems. In this paper, we propose an approach to query expansion that leverages the generative abilities…

cs.IR2022

Towards Disentangling Relevance and Bias in Unbiased Learning to Rank

Yunan Zhang, Le Yan, Zhen Qin +5

Unbiased learning to rank (ULTR) studies the problem of mitigating various biases from implicit user feedback data such as clicks, and has been receiving considerable attention rec…

cs.IR2022

Learning List-Level Domain-Invariant Representations for Ranking

Ruicheng Xian, Honglei Zhuang, Zhen Qin +7

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning,…

cs.IR2022★ 5 cited

RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Honglei Zhuang, Zhen Qin, Rolf Jagerman +6

Recently, substantial progress has been made in text ranking based on pretrained language models such as BERT. However, there are limited studies on how to leverage more powerful s…

cs.IR2022★ 1 cited

Retrieval Augmentation for T5 Re-ranker using External Sources

Kai Hui, Tao Chen, Zhen Qin +4

Retrieval augmentation has shown promising improvements in different tasks. However, whether such augmentation can assist a large language model based re-ranker remains unclear. We…

cs.IR2021★ 1 cited

Improving Neural Ranking via Lossless Knowledge Distillation

Zhen Qin, Le Yan, Yi Tay +4

We explore a novel perspective of knowledge distillation (KD) for learning to rank (LTR), and introduce Self-Distilled neural Rankers (SDR), where student rankers are parameterized…

cs.IR2020★ 15 cited

RRF102: Meeting the TREC-COVID Challenge with a 100+ Runs Ensemble

Michael Bendersky, Honglei Zhuang, Ji Ma +3

In this paper, we report the results of our participation in the TREC-COVID challenge. To meet the challenge of building a search engine for rapidly evolving biomedical collection,…

cs.IR2020★ 5 cited

Interpretable Learning-to-Rank with Generalized Additive Models

Honglei Zhuang, Xuanhui Wang, Michael Bendersky +7

Interpretability of learning-to-rank models is a crucial yet relatively under-examined research area. Recent progress on interpretable ranking models largely focuses on generating…

cs.IR2019★ 2 cited

Separate and Attend in Personal Email Search

Yu Meng, Maryam Karimzadehgan, Honglei Zhuang +1

In personal email search, user queries often impose different requirements on different aspects of the retrieved emails. For example, the query "my recent flight to the US" require…