4 papers
Decoupling Search from Reasoning: A Vendor-Agnostic Grounding Architecture for LLM Agents
Emmanuel Aboah Boateng, Kyle MacDonald, Amardeep Kumar +2
Production LLM agents increasingly depend on real-time search, yet native search grounding bundles retrieval policy, provider choice, evidence injection, cost, latency, and generat…
Benchmark Dataset Generation and Evaluation for Excel Formula Repair with LLMs
Ananya Singha, Harshita Sahijwani, Walt Williams +10
Excel is a pervasive yet often complex tool, particularly for novice users, where runtime errors arising from logical mistakes or misinterpretations of functions pose a significant…
Auto-Eval Judge: Towards a General Agentic Framework for Task Completion Evaluation
Roshita Bhonsle, Rishav Dutta, Sneha Vavilapalli +8
The increasing adoption of foundation models as agents across diverse domains necessitates a robust evaluation framework. Current methods, such as LLM-as-a-Judge, focus only on fin…
Concept Distillation from Strong to Weak Models via Hypotheses-to-Theories Prompting
Emmanuel Aboah Boateng, Cassiano O. Becker, Nabiha Asghar +5
Hand-crafting high quality prompts to optimize the performance of language models is a complicated and labor-intensive process. Furthermore, when migrating to newer, smaller, or we…