most citedJustice or Prejudice? Quantifying Biases in LLM-as-a-Judge

8 citations · 14 across the 8 of their papers we have counts for

collaborators

8 papers

cs.AI2026

AUSO: Action-Level Unified Skill Optimization from Internalization to Utilization

Huizu Lin, Chengkai Huang, Tianqi Gao +5

Skills play different roles as an agent's policy evolves: they should first provide learnable knowledge, then support capability formation, and finally be invoked only when they im…

cs.IR2026

Beyond Item Order: Temporal Gap Tokenization for Generative Recommendation with Semantic IDs

Chengkai Huang, Tianqi Gao, Hongtao Huang +2

Semantic-ID-based generative recommendation has recently emerged as a scalable paradigm for sequential recommendation, where each item is represented by a compact sequence of discr…

cs.LG2026

Getting Better at Working With You: Compiling User Corrections into Runtime Enforcement for Coding Agents

Yujun Zhou, Kehan Guo, Haomin Zhuang +8

Interactive LLM agents are becoming part of daily work, but they do not reliably become easier to work with over time: a correction remembered in one session may still be violated…

cs.CL2026

Reflections and New Directions for Human-Centered Large Language Models

Caleb Ziems, Dora Zhao, Rose E. Wang +55

Large Language Models (LLMs) are increasingly shaping the private and professional lives of users, with numerous applications in business, education, finance, healthcare, law, and…

cs.IR2026

Factorized Latent Reasoning for LLM-based Recommendation

Tianqi Gao, Chengkai Huang, Zihan Wang +3

Large language models (LLMs) have recently been adopted for recommendation by framing user preference modeling as a language generation problem. However, existing latent reasoning…

cs.LG2026

Alignment Risks from Capability-Seeking RL Training

Yujun Zhou, Yue Huang, Han Bao +8

While most AI alignment research focuses on preventing models from generating explicitly harmful content, a more subtle risk arises from capability-seeking RL training in vulnerabl…

cs.CL2024★ 8 cited

Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge

Jiayi Ye, Yanbo Wang, Yue Huang +9

LLM-as-a-Judge has been widely utilized as an evaluation method in various benchmarks and served as supervised rewards in model training. However, despite their excellence in many…

cs.CL2024★ 6 cited

LabSafety Bench: Benchmarking LLMs on Safety Issues in Scientific Labs

Yujun Zhou, Jingdong Yang, Yue Huang +12

Artificial Intelligence (AI) is revolutionizing scientific research, yet its growing integration into laboratory environments presents critical safety challenges. Large language mo…