Language models suffer from a curse of ambiguity

Nicolas Zucchet, Hyun Dong Lee, Scott Linderman

Large language models increasingly rely on sampling as a driver of their own improvement, making the fidelity of their learned distributions more critical than ever. Yet, not all d…