4 papers
RankSteer: Activation Steering for Pointwise LLM Ranking
Yumeng Wang, Catherine Chen, Suzan Verberne
Large language models (LLMs) have recently shown strong performance as zero-shot rankers, yet their effectiveness is highly sensitive to prompt formulation, particularly role-play…
Needle in the Web: A Benchmark for Retrieving Targeted Web Pages in the Wild
Yumeng Wang, Tianyu Fan, Lingrui Xu +1
Large Language Models (LLMs) have evolved from simple chatbots into sophisticated agents capable of automating complex real-world tasks, where browsing and reasoning over live web…
How role-play shapes relevance judgment in zero-shot LLM rankers
Yumeng Wang, Jirui Qi, Catherine Chen +2
Large Language Models (LLMs) have emerged as promising zero-shot rankers, but their performance is highly sensitive to prompt formulation. In particular, role-play prompts, where t…
CoKnowledge: Supporting Assimilation of Time-synced Collective Knowledge in Online Science Videos
Yuanhao Zhang, Yumeng Wang, Xiyuan Wang +3
Danmaku, a system of scene-aligned, time-synced, floating comments, can augment video content to create 'collective knowledge'. However, its chaotic nature often hinders viewers fr…