Enhancing Instruction-Following Capabilities in Seq2Seq Models: DoLA Adaptations for T5

Huey Sun, Anabel Yong, Lorenzo Gilly +1

Encoder-decoder models such as FLAN-T5 are finetuned to follow instructions, but often fail when the instructions conflict with memorized continuations ingrained during training. T…