4 papers
EvoProbe: Evaluation-Driven Benchmark Evolution for LLM Agents
Qianhong Guo, Wei Xie, Xiaofang Cai +3
Static benchmarks for large language model (LLM) agents face saturation and data contamination risks, motivating continual updates to evaluation tasks. However, aggregate scores an…
Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Another
Wangshu Zhu, Qianwen Guo, Yushun Dong
LLM agents increasingly operate over multiple entities, where reliable response generation requires not only retrieving relevant evidence but also preserving its association with t…
An Embarrassingly Simple Detector for Model Extraction Attacks in Large Language Model API Traffic
Shuze Liu, Qianwen Guo, Yushun Dong
Large language models (LLMs) are increasingly deployed through hosted APIs, making model extraction a practical threat to model ownership and service security. Individual extractio…
League of LLMs: A Benchmark-Free Paradigm for Mutual Evaluation of Large Language Models
Qianhong Guo, Wei Xie, Xiaofang Cai +7
Although large language models (LLMs) have shown exceptional capabilities across a wide range of tasks, reliable evaluation remains a critical challenge due to data contamination,…