6 papers
Before Agents Speak: Pre-hoc Failure Risk Inference in Multi-Agent Systems
Shi Lin, Chenpei Wang, Peng Qian +4
LLM-based multi-agent systems (MAS) have exhibited remarkable capabilities in collaborative reasoning and decision-making, yet their interconnected communications introduce new sys…
Forecasting Trajectory-Level Safety Risks in Black-Box Multi-Turn Interactions
Shi Lin, Peng Qian, Dinghao Liu +5
As large language models (LLMs) evolve from standalone assistants into autonomous agents, ensuring their safety requires shifting beyond pointwise risk assessment to understand how…
Benchmarking Empirical Privacy Protection for Adaptations of Large Language Models
Bartłomiej Marek, Lorenzo Rossi, Vincent Hanke +4
Recent work has applied differential privacy (DP) to adapt large language models (LLMs) for sensitive applications, offering theoretical guarantees. However, its practical effectiv…
Pushing the Limits of Safety: A Technical Report on the ATLAS Challenge 2025
Zonghao Ying, Siyang Wu, Run Hao +44
Multimodal Large Language Models (MLLMs) have enabled transformative advancements across diverse applications but remain susceptible to safety threats, especially jailbreak attacks…
A Survey of LLM-Driven AI Agent Communication: Protocols, Security Risks, and Defense Countermeasures
Dezhang Kong, Shi Lin, Zhenhua Xu +16
In recent years, Large-Language-Model-driven AI agents have exhibited unprecedented intelligence and adaptability. Nowadays, agents are undergoing a new round of evolution. They no…
Reasoning as a Weapon: Adaptive Dual-Path Jailbreak Attack on Large Language Models
Shi Lin, Peng Qian, Hongming Yang +3
Large language models (LLMs) have achieved remarkable progress across a wide range of applications. Despite advances in safety alignment, they remain vulnerable to jailbreak attack…