4 papers · 1 filter
AutoDojo: A Generative Benchmark for Evaluating Prompt Injection Defenses in LLM Agents
Xinhang Ma, Taoran Li, Chaowei Xiao +3
Indirect prompt injection (IPI) is a major security threat to LLM-powered agents. Thus, a growing body of work has proposed a variety of defensive approaches against IPI which can…
Layer-Targeted Multilingual Knowledge Erasure in Large Language Models
Taoran Li, Varun Chandrasekaran, Zhiyuan Yu
Recent work has demonstrated that machine unlearning in Large Language Models (LLMs) fails to generalize across languages: knowledge erased in one language frequently remains acces…
The Erasure Illusion: Stress-Testing the Generalization of LLM Forgetting Evaluation
Hengrui Jia, Taoran Li, Jonas Guan +1
Machine unlearning aims to remove specific data influences from trained models, a capability essential for adhering to copyright laws and ensuring AI safety. Current unlearning met…
SoK: Understanding (New) Security Issues Across AI4Code Use Cases
Qilong Wu, Taoran Li, Tianyang Zhou +1
AI-for-Code (AI4Code) systems are reshaping software engineering, with tools like GitHub Copilot accelerating code generation, translation, and vulnerability detection. Alongside t…