Task Competence Is Not Instruction Following: Evaluating Instruction-Conflicting Behavior in Small Language Models

Mahdiyeh Farajidizaji, Vatsal Raina

Instruction tuning is meant to make language models follow user requests, yet it is unclear whether small models comply when an instruction conflicts with their usual task behavior…