Safeguards Based on Copyable Context Cannot Provide Reliable Safety for LLMs

Pingyu Wu, Lingyao Zhu, Weiming Zhang +1

Large language model safeguards decide whether to answer before seeing how an answer will be used. This creates a basic problem for dual-use tasks: the same answer can help an auth…