5 papers · 1 filter
ROPE: Routed Origin Policy Enforcement against Indirect Prompt Injection
Xinhang Ma, Chaowei Xiao, William Yeoh +2
Indirect prompt injection (IPI) plants instructions in the content a tool-using LLM agent reads, steering the agent into harmful tool calls. The strongest defenses are system-level…
Robust Context-Aware Detection of Malicious Instructions in Text
Buzhao Liu, Xinhang Ma, Yevgeniy Vorobeychik
The remarkable instruction-following ability of modern LLMs has enabled their practical use as the minds of agents that can autonomously complete increasingly complex tasks. Therei…
AutoDojo: A Generative Benchmark for Evaluating Prompt Injection Defenses in LLM Agents
Xinhang Ma, Taoran Li, Chaowei Xiao +3
Indirect prompt injection (IPI) is a major security threat to LLM-powered agents. Thus, a growing body of work has proposed a variety of defensive approaches against IPI which can…
Conformal Reachability for Safe Control in Unknown Environments
Xinhang Ma, Junlin Wu, Yiannis Kantaros +1
Designing provably safe control is a core problem in trustworthy autonomy. However, most prior work in this regard assumes either that the system dynamics are known or deterministi…
Protecting Language Models Against Unauthorized Distillation through Trace Rewriting
Xinhang Ma, William Yeoh, Ning Zhang +1
Knowledge distillation is a widely adopted technique for transferring capabilities from LLMs to smaller, more efficient student models. However, unauthorized use of knowledge disti…