1 citations · 1 across the 10 of their papers we have counts for
7 papers · 1 filter
Revealing what benchmark scores hide: Jointly measuring the breadth and reliability of LLM capabilities using accessibility profiles
Kazem Faghih, Yize Cheng, Shoumik Saha +3
Language model benchmarks assign each question a single outcome from one fixed wording, even though the same underlying request can be expressed in many equivalent ways. We argue t…
Hierarchical Reinforcement Learning with Stable Temporal Abstraction for Language Model Agents
Shayan Mohajer Hamidi, Yize Cheng, Yuanda Xu +2
Hierarchical reinforcement learning improves long-horizon control by organizing primitive actions around persistent subgoals and assigning credit at multiple temporal scales. Recen…
Thinking Hard, Not Smart: Reasoning Models Fail to Ration Test-Time Compute Across Questions
Chenrui Fan, Yize Cheng, Ming Li +3
Reasoning language models increasingly use test-time compute to improve performance, but existing evaluations typically study this compute one question at a time. Yet when multiple…
Same Question, Different Answers: Evaluating LLM Reliability Beyond Accuracy
Kazem Faghih, Yize Cheng, Shoumik Saha +3
Large language models (LLMs) often achieve strong accuracy on benchmarks, yet it remains unclear how reliably they apply this knowledge when the same question is phrased in differe…
When is Your LLM Steerable?
Chenrui Fan, Yize Cheng, Ming Li +2
Activation steering offers a lightweight approach to control language models' behavior at inference time, but whether it succeeds or fails heavily depends on the prompt, concept, m…
Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use
Yize Cheng, Chenrui Fan, Mahdi JafariRaviz +2
Large language models (LLMs) increasingly act as autonomous agents that must decide when to answer directly vs. when to invoke external tools. Prior work studying adaptive tool use…
Failing to Explore: Language Models on Interactive Tasks
Mahdi JafariRaviz, Keivan Rezaei, Arshia Soltani Moakhar +3
We evaluate language models on their ability to explore interactive environments under a limited interaction budget. We introduce three parametric tasks with controllable explorati…