You Only Pass Once: Answering and Abstaining Together in a Single Forward Pass of a Frozen Language Model

Ziyang Luo, Zhongyao Chu, Xinjie He +4

A frozen language model under-uses the evidence in its hidden states and answers confidently when the context contains no answer. We fix both on the residual stream without changin…