Instruction Tuning With Loss Over Instructions

Zhengyan Shi, Adam X. Yang, Bin Wu +3

Instruction tuning plays a crucial role in shaping the outputs of language models (LMs) to desired styles. In this work, we propose a simple yet effective method, Instruction Model…