7 papers · 1 filter
Resilience Matters for Embodied Agents System: New Metrics, Systematic Evaluation, and Optimization
Yapeng Liu, Yuanzhao Zhai, Xudong Gong +4
Embodied Agents System (EAS) are increasingly deployed in open-world physical domains, where reliability directly dictates deployment quality and human-agent trust. However, existi…
ReFrame: Evidence-Guided Test-Time Safety Alignment in Multimodal Large Language Models
Wenzheng Jiang, Xuankun Rong, Yuanzhao Zhai +2
While multimodal large language models (MLLMs) extend model capabilities beyond text, they also make safety alignment increasingly challenging. Multimodal safety alignment methods…
An Empirical Study on the Impact of Normalized Use-Case Specifications on Traceability
Luoyuan Shi, Yuanzhao Zhai, Dawei Feng +4
Traceability link recovery between requirements and source code is vital for software quality assurance and evolution analysis. Although automated traceability techniques have adva…
MCPEvol-Bench: Benchmarking LLM Agent Performance Across Dynamic Evolutions of MCP Servers
Huanxi Liu, Kun Hu, Jiaqi Liao +6
As Model Context Protocol (MCP) servers emerge as the core infrastructure for connecting LLMs with external tools, existing benchmarks leverage real-world MCP servers to evaluate L…
ParetoPilot: Zero-Surrogate Offline Multi-Objective Optimization via Infer-Perturb-Guide Diffusion
Ruiqing Sun, Sen Yang, Dawei Feng +3
Offline multi-objective optimization (Offline MOO) seeks Pareto-optimal designs from static datasets without additional environment interactions. Existing generative methods typica…
Beyond Scores: Diagnostic LLM Evaluation via Fine-Grained Abilities
Xu Zhang, Xudong Gong, Jiacheng Qin +5
Current evaluations of large language models aggregate performance across diverse tasks into single scores. This obscures fine-grained ability variation, limiting targeted model im…
Ranking Constraints via Topological Dual-Directional Search in Evolutionary Multi-Objective Optimization
Ruiqing Sun, Dawei Feng, Sheng Qi +6
Existing evolutionary algorithms for Constrained Multi-objective Optimization Problems (CMOPs) typically treat all constraints uniformly, overlooking their distinct geometric relat…