Addressing the Ecological Fallacy in Larger LMs with Human Context

Nikita Soni, Dhruv Vijay Kunjadiya, Pratham Piyush Shah +3

Language model training and inference ignore a fundamental linguistic fact -- there is a dependence between multiple sequences of text written by the same person. Prior work has sh…