LLM generation novelty through the lens of semantic similarity

Philipp Davydov, Ameya Prabhu, Matthias Bethge +2

Generation novelty is a key indicator of an LLM's ability to generalize, yet measuring it against full pretraining corpora is computationally challenging. Existing evaluations ofte…