Waste Not, Want Not; Recycled Gumbel Noise Improves Consistency in Natural Language Generation

Damien de Mijolla, Hannan Saddiq, Kim Moore

Consistency in the output of language models is critical for their reliability and practical utility. Due to their training objective, language models learn to model the full space…