6 papers · 1 filter
When Agent Context Goes Stale: Incoherence in Volatile Agent Context
Yingying Liu, Junzhou Fang, Chenxiong Qian
Modern agents increasingly ground their reasoning in observations returned by tools, such as file contents read from a workspace. However, the data sources underlying these observa…
FrontierChallenge: Evaluating Scientific Workflow Completion
Liangcai Su, Zhaopeng Feng, Zhuo Chen +14
Scientific agents increasingly analyze data, execute code, and produce research artifacts, yet most benchmarks emphasize final answers, isolated programs, or a single domain. We in…
SWE-Test: Benchmarking LLM Vulnerability Discovery via Input Prediction
Yuanxiang Shi, Jiayi Lin, Xuanyong Lin +8
Vulnerability discovery is becoming an important ability of large language model (LLM) agents: agents that silently miss real defects leave critical software exposed. Rigorously me…
MOA: A Profiling-Guided LLM Framework for Memory-Optimization Automation at Codebase Scale
Jiaxi Liang, Yuanxiang Shi, Zezhou Yang +1
Modern large-scale software systems often suffer from pervasive memory inefficiencies (e.g., bloat, churn), leading to excessive resource costs and performance degradation. Existin…
GMP: A Benchmark for Content Moderation under Co-occurring Violations and Dynamic Rules
Houde Dong, Yifei She, Kai Ye +3
Online content moderation is essential for maintaining a healthy digital environment, and reliance on AI for this task continues to grow. Consider a user comment using national ste…
XGuardian: Towards Explainable and Generalized AI Anti-Cheat on FPS Games
Jiayi Zhang, Chenxin Sun, Chenxiong Qian
Aim-assist cheats are the most prevalent and infamous form of cheating in First-Person Shooter (FPS) games, which help cheaters illegally reveal the opponent's location and auto-ai…