4 citations · 4 across the 6 of their papers we have counts for
9 papers
GraphACM: Graph-based Action Consistency Measurement for Uncertainty Quantification in LLM Agents
Yaxin Ma, Wenbo Zhang, Satya Krishna Pothapragada +1
Behavioral consistency across repeated executions provides an informative signal for assessing the reliability of large language model (LLM) agents. However, existing approaches ty…
OTROPE: Optimal Transport-based Robust Off-policy Evaluation for Large Language Models
Liner Xiang, Wenbo Zhang, Hengrui Cai
Reliable evaluation of large language models (LLMs) is essential for their development and deployment, yet is often costly, risky, and difficult to perform safely online. We study…
Towards Bridging the Gap Between Offline and Iterative Alignment via Preference Distillation
Wenbo Zhang, Wenzhuo Zhou, Hengrui Cai +1
Direct preference optimization DPO is a promising offline approach for aligning large language models (LLMs) due to its simplicity, computational efficiency, and implicit modeling…
Reasoning Is Not Free: Robust Adaptive Cost-Efficient Routing for LLM-as-a-Judge
Wenbo Zhang, Lijinghua Zhang, Liner Xiang +1
Reasoning-capable large language models (LLMs) have recently been adopted as automated judges, but their benefits and costs in LLM-as-a-Judge settings remain unclear. Through contr…
Supervised Fine-Tuning versus Reinforcement Learning: A Study of Post-Training Methods for Large Language Models
Haitao Jiang, Wenbo Zhang, Jiarui Yao +3
Pre-trained Large Language Model (LLM) exhibits broad capabilities, yet, for specific tasks or domains their attainment of higher accuracy and more reliable reasoning generally dep…
Where to Intervene: Action Selection in Deep Reinforcement Learning
Wenbo Zhang, Hengrui Cai
Deep reinforcement learning (RL) has gained widespread adoption in recent years but faces significant challenges, particularly in unknown and complex environments. Among these, hig…
Beyond the Singular: Revealing the Value of Multiple Generations in Benchmark Evaluation
Wenbo Zhang, Hengrui Cai, Wenyu Chen
Large language models (LLMs) have demonstrated significant utility in real-world applications, exhibiting impressive capabilities in natural language processing and understanding.…
Recognizing Limits: Investigating Infeasibility in Large Language Models
Wenbo Zhang, Zihang Xu, Hengrui Cai
Large language models (LLMs) have shown remarkable performance in various tasks but often fail to handle queries that exceed their knowledge and capabilities, leading to incorrect…
Towards Trustworthy Explanation: On Causal Rationalization
Wenbo Zhang, Tong Wu, Yunlong Wang +2
With recent advances in natural language processing, rationalization becomes an essential self-explaining diagram to disentangle the black box by selecting a subset of input texts…