4 papers · 1 filter
Passes Alone, Fails Together: Benchmarking Semantic Coordination in Parallel LLM-Agent Development
Haocheng Xia, Eugene Wu, Yongjoo Park
Parallel coding agents can produce patches that work alone but fail when merged. This happens when one agent changes an interface or rule that another agent still relies on. We stu…
Environment Steering: Using Data Flow Control to Improve Agent Utility and Safety
Charlie Summers, Prajwal Raghunath, Aaditya Pai +4
LLM agents can make unsafe tool calls even when instructed to behave safely. Existing defenses constrain agents before execution, modify tool inputs/outputs, or rely on LLM judges;…
SANA: What Matters for QA Agents over Massive Data Lakes?
Austin Senna Wijaya, Jiaxiang Liu, Haonan Wang +1
Exploratory question answering (EQA) over data lakes requires an LLM agent to discover relevant sources, analyze retrieved data, and adapt its actions based on intermediate results…
LakeQA: An Exploratory QA Benchmark over a Million-Scale Data Lake
Haonan Wang, Jiaxiang Liu, Yurong Liu +11
Recent large language models (LLMs) have shown rapid progress in reading-based question answering (QA), where evidence is explicitly provided or can be trivially retrieved. In cont…