Do LLMs Know Their Vulnerable Scenarios?

Ziheng Peng, Huiqi Deng, Haoran Jing +5

Safety-aligned large language models are trained to refuse harmful requests, yet embedding the same requests in particular scenarios can bypass their safeguards. Existing red-teami…