Neural Diversity Regularizes Hallucinations in Language Models

Kushal Chakrabarti, Nirmal Balachundhar

Language models continue to hallucinate despite increases in parameters, compute, and data. We propose neural diversity -- decorrelated parallel representations -- as a principled…