activity
20202026
most citedNon-Clicks Mean Irrelevant? Propensity Ratio Scoring As a Correction

24 citations · 99 across the 22 of their papers we have counts for

collaborators

22 papers

cs.IR2026

CRAMER: Control via Request-Aware Masking for Editing Recommenders

Zhiyuan Julian Su, Naihe Feng, Zhen Luther Qin +1

Sequential recommendation models, while powerful, have limited flexibility in responding to immediate user requests, making it difficult to adapt their recommendations to the user'…

cs.LG2026

Exposure-Based Reinforcement Learning to Rank

Harrie Oosterhuis, Rolf Jagerman, Zhen Qin +1

Reinforcement learning (RL) methods for learning-to-rank (LTR) can optimize (almost) any ranking goal, e.g., from precision or discounted cumulative gain to fairness-of-exposure or…

cs.IR2026

Retrieval Augmented Conversational Recommendation with Reinforcement Learning

Zhenrui Yue, Honglei Zhuang, Zhen Qin +4

Large language models (LLMs) exhibit enhanced capabilities in language understanding and generation. By utilizing their embedded knowledge, LLMs are increasingly used as conversati…

cs.IR2025

Optimizing Compound Retrieval Systems

Harrie Oosterhuis, Rolf Jagerman, Zhen Qin +1

Modern retrieval systems do not rely on a single ranking model to construct their rankings. Instead, they generally take a cascading approach where a sequence of ranking models are…

cs.CL2024

Integrating Planning into Single-Turn Long-Form Text Generation

Yi Liang, You Wu, Honglei Zhuang +8

Generating high-quality, in-depth textual documents, such as academic papers, news articles, Wikipedia entries, and books, remains a significant challenge for Large Language Models…

cs.CL2024★ 3 cited

Inference Scaling for Long-Context Retrieval Augmented Generation

Zhenrui Yue, Honglei Zhuang, Aijun Bai +7

The scaling of inference computation has unlocked the potential of long-context large language models (LLMs) across diverse settings. For knowledge-intensive tasks, the increased c…

cs.IR2024★ 3 cited

Reliable Confidence Intervals for Information Retrieval Evaluation Using Generative A.I

Harrie Oosterhuis, Rolf Jagerman, Zhen Qin +2

The traditional evaluation of information retrieval (IR) systems is generally very costly as it requires manual relevance annotation from human experts. Recent advancements in gene…

cs.IR2024

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing

Le Yan, Zhen Qin, Honglei Zhuang +4

The powerful generative abilities of large language models (LLMs) show potential in generating relevance labels for search applications. Previous work has found that directly askin…

cs.IR2023★ 13 cited

Can Query Expansion Improve Generalization of Strong Cross-Encoder Rankers?

Minghan Li, Honglei Zhuang, Kai Hui +5

Query expansion has been widely used to improve the search results of first-stage retrievers, yet its influence on second-stage, cross-encoder rankers remains under-explored. A rec…

cs.IR2023★ 2 cited

PaRaDe: Passage Ranking using Demonstrations with Large Language Models

Andrew Drozdov, Honglei Zhuang, Zhuyun Dai +8

Recent studies show that large language models (LLMs) can be instructed to effectively perform zero-shot passage re-ranking, in which the results of a first stage retrieval method,…

cs.IR2023★ 7 cited

Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels

Honglei Zhuang, Zhen Qin, Kai Hui +4

Zero-shot text rankers powered by recent LLMs achieve remarkable ranking performance by simply prompting. Existing prompts for pointwise LLM rankers mostly ask the model to choose…

cs.IR2023

Learning to Rank when Grades Matter

Le Yan, Zhen Qin, Gil Shamir +3

Graded labels are ubiquitous in real-world learning-to-rank applications, especially in human rated relevance data. Traditional learning-to-rank techniques aim to optimize the rank…

cs.IR2023★ 1 cited

RD-Suite: A Benchmark for Ranking Distillation

Zhen Qin, Rolf Jagerman, Rama Pasumarthi +6

The distillation of ranking models has become an important topic in both academia and industry. In recent years, several advanced methods have been proposed to tackle this problem,…

cs.IR2023★ 19 cited

Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting

Zhen Qin, Rolf Jagerman, Kai Hui +9

Ranking documents using Large Language Models (LLMs) by directly feeding the query and candidate documents into the prompt is an interesting and practical problem. However, researc…

cs.IR2023★ 20 cited

Query Expansion by Prompting Large Language Models

Rolf Jagerman, Honglei Zhuang, Zhen Qin +2

Query expansion is a widely used technique to improve the recall of search systems. In this paper, we propose an approach to query expansion that leverages the generative abilities…

cs.IR2022

Towards Disentangling Relevance and Bias in Unbiased Learning to Rank

Yunan Zhang, Le Yan, Zhen Qin +5

Unbiased learning to rank (ULTR) studies the problem of mitigating various biases from implicit user feedback data such as clicks, and has been receiving considerable attention rec…

cs.IR2022

Learning List-Level Domain-Invariant Representations for Ranking

Ruicheng Xian, Honglei Zhuang, Zhen Qin +7

Domain adaptation aims to transfer the knowledge learned on (data-rich) source domains to (low-resource) target domains, and a popular method is invariant representation learning,…

cs.IR2022

Regression Compatible Listwise Objectives for Calibrated Ranking with Binary Relevance

Aijun Bai, Rolf Jagerman, Zhen Qin +6

As Learning-to-Rank (LTR) approaches primarily seek to improve ranking quality, their output scores are not scale-calibrated by design. This fundamentally limits LTR usage in score…

cs.IR2022★ 5 cited

RankT5: Fine-Tuning T5 for Text Ranking with Ranking Losses

Honglei Zhuang, Zhen Qin, Rolf Jagerman +6

Recently, substantial progress has been made in text ranking based on pretrained language models such as BERT. However, there are limited studies on how to leverage more powerful s…

cs.IR2022★ 1 cited

Retrieval Augmentation for T5 Re-ranker using External Sources

Kai Hui, Tao Chen, Zhen Qin +4

Retrieval augmentation has shown promising improvements in different tasks. However, whether such augmentation can assist a large language model based re-ranker remains unclear. We…

cs.IR2021★ 1 cited

Improving Neural Ranking via Lossless Knowledge Distillation

Zhen Qin, Le Yan, Yi Tay +4

We explore a novel perspective of knowledge distillation (KD) for learning to rank (LTR), and introduce Self-Distilled neural Rankers (SDR), where student rankers are parameterized…

cs.IR2020★ 24 cited

Non-Clicks Mean Irrelevant? Propensity Ratio Scoring As a Correction

Nan Wang, Zhen Qin, Xuanhui Wang +1

Recent advances in unbiased learning to rank (LTR) count on Inverse Propensity Scoring (IPS) to eliminate bias in implicit feedback. Though theoretically sound in correcting the bi…