11 papers
Environment-free Synthetic Data Generation for API-Calling Agents
Seanie Lee, Sanjoy Chowdhury, Chao Jiang +5
Training API-calling large language model (LLM) agents demands massive amounts of high-quality trajectories. However, collecting such data at scale typically requires fully impleme…
COMPASS: Benchmarking Constrained Optimization in LLM Agents
Tian Qin, Felix Bai, Ting-Yao Hu +8
Human decision-making often involves constrained optimization. As LLM agents are deployed to assist with real-world tasks like travel planning, shopping, and scheduling, they must…
ASTRA-bench: Evaluating Tool-Use Agent Reasoning and Action Planning with Personal User Context
Zidi Xiu, David Q. Sun, Kevin Cheng +9
Next-generation AI must manage vast personal data, diverse tools, and multi-step reasoning, yet most benchmarks remain context-free and single-turn. We present ASTRA-bench (Assista…
Learning from Self Critique and Refinement for Faithful LLM Summarization
Ting-Yao Hu, Hema Swetha Koppula, Hadi Pouransari +3
Large Language Models (LLMs) often suffer from hallucinations: output content that is not grounded in the input context, when performing long-form text generation tasks such as sum…
AMUSE: Audio-Visual Benchmark and Alignment Framework for Agentic Multi-Speaker Understanding
Sanjoy Chowdhury, Karren D. Yang, Xudong Liu +6
Recent multimodal large language models (MLLMs) such as GPT-4o and Qwen3-Omni show strong perception but struggle in multi-speaker, dialogue-centric settings that demand agentic re…
Learning to Reason for Hallucination Span Detection
Hsuan Su, Ting-Yao Hu, Hema Swetha Koppula +7
Large language models (LLMs) often generate hallucinations -- unsupported content that undermines reliability. While most prior works frame hallucination detection as a binary task…