Do Large Language Models Capture the Diversity in their Training Data?

Youqi Wu, Farzan Farnia

Large language models are trained to model conditional distributions over text, yet it remains inadequately understood whether they capture the full diversity of plausible outputs…