4 papers
PointerBench: A Diagnostic Benchmark for Fine-Grained GUI Grounding
Valentino Sacco, Saurabh Pandey, Alexander Florian Jercher +1
Multimodal Large Language Models have shown promising performance in computer-use tasks, from planning user workflows to grounding natural-language actions to precise UI targets. E…
Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities
Yikai Zhao, Saurabh Pandey, Pradeep Kumar Misra
A deployed LLM agent emits tool calls, queries, and code that can be silently wrong -- by the time the error surfaces, the action has run. Frontier chat APIs hide the model's token…
A Tri-Agent Framework for Evaluating and Aligning Question Clarification Capabilities of Large Language Models
Yikai Zhao, Saurabh Pandey, Pradeep Kumar Misra
Large Language Models (LLMs) are increasingly deployed in interactive systems where understanding user intent precisely is paramount. A key capability for such systems is effective…
TRACE: TRajectory Attribution for Automated Context Engineering
Yikai Zhao, Pradeep Kumar Misra, Saurabh Pandey
Production AI agents fail when their context sources -- system prompts, knowledge bases, tool descriptions, and procedural skills -- contain errors or gaps. Current maintenance rel…