Refusal-Gated Decoding: Preserving Refusal Behavior Under High-Temperature Sampling

Phillip Howard, Xin Su, Allen Roush +3

Recent advances in truncation-based sampling have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity withou…