Safeguarding LLM Agents from Misalignment through Provenance Analysis

Yining She, Yiliang Liang, Eunsuk Kang

As LLM agents gain increasing access to powerful tools, ensuring that their actions align with the user's intent becomes critical. When an agent's proposed action deviates from tha…