Linear Correlation in LM's Compositional Generalization and Hallucination

Letian Peng, Chenyang An, Shibo Hao +2

The generalization of language models (LMs) is undergoing active debates, contrasting their potential for general intelligence with their struggles with basic knowledge composition…