On the Exploitability of Instruction Tuning

Manli Shu, Jiongxiao Wang, Chen Zhu +3

Instruction tuning is an effective technique to align large language models (LLMs) with human intents. In this work, we investigate how an adversary can exploit instruction tuning…