4 papers
OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models
Liner Xiang, Wenbo Zhang, Hengrui Cai
Reliable evaluation of large language models (LLMs) is essential for their development and deployment, yet is often costly, risky, and difficult to perform safely online. We study…
Policy Optimization and Statistical Inference for Online Contextual Matrix Games
Liner Xiang, Yixin Wang, Hengrui Cai
Online decision making often requires navigating a landscape shaped by both dynamic contexts and strategic interactions. In competitive pricing, for example, hotels must account fo…
Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
Wenbo Zhang, Lijinghua Zhang, Liner Xiang +1
Reasoning-capable large language models (LLMs) have recently been adopted as automated judges, but their benefits and costs in LLM-as-a-Judge settings remain unclear. Through contr…
Foresighted Online Policy Optimization with Interference
Liner Xiang, Jiayi Wang, Hengrui Cai
Contextual bandits, which leverage the baseline features of sequentially arriving individuals to optimize cumulative rewards while balancing exploration and exploitation, are criti…