3 papers
cs.LG2026
RECAP: Regression Evaluation for Continual Adaptation of Prompts
Harsh Deshpande, Kushal Chawla, Sangwoo Cho +2
Production agentic systems routinely face evolving constraints and must comply from the very next interaction. Scenarios like a tool-call notification changing a compliance thresho…
cs.CL2024
NovAScore: A New Automated Metric for Evaluating Document Level Novelty
Lin Ai, Ziwei Gong, Harshsaiprasad Deshpande +4
The rapid expansion of online content has intensified the issue of information redundancy, underscoring the need for solutions that can identify genuinely new information. Despite…
cs.CL2024
CREAM: Comparison-Based Reference-Free ELO-Ranked Automatic Evaluation for Meeting Summarization
Ziwei Gong, Lin Ai, Harshsaiprasad Deshpande +5
Large Language Models (LLMs) have spurred interest in automatic evaluation methods for summarization, offering a faster, more cost-effective alternative to human evaluation. Howeve…