Nearest Neighbor Speculative Decoding for LLM Generation and Attribution

Minghan Li, Xilun Chen, Ari Holtzman +4

Large language models (LLMs) often hallucinate and lack the ability to provide attribution for their generations. Semi-parametric LMs, such as kNN-LM, approach these limitations by…