Showing cs.AIShow all
3 papers · 1 filter
cs.AI2026
RPRA: Predicting an LLM-Judge for Efficient but Performant Inference
Dylan R. Ashley, Gaël Le Lan, Changsheng Zhao +7
Large language models (LLMs) face a fundamental trade-off between computational efficiency (e.g., number of parameters) and output quality, especially when deployed on computationa…
cs.AI2024
How to Correctly do Semantic Backpropagation on Language-based Agentic Systems
Wenyi Wang, Hisham A. Alyahya, Dylan R. Ashley +4
Language-based agentic systems have shown great promise in recent years, transitioning from solving small-scale research problems to being deployed in challenging real-world tasks.…
cs.AI2024
Agent-as-a-Judge: Evaluate Agents with Agents
Mingchen Zhuge, Changsheng Zhao, Dylan Ashley +10
Contemporary evaluation techniques are inadequate for agentic systems. These approaches either focus exclusively on final outcomes -- ignoring the step-by-step nature of agentic sy…