LMEnt: A Suite for Analyzing Knowledge in Language Models from Pretraining Data to Representations

Daniela Gottesman, Alon Gilae-Dotan, Ido Cohen +4

Language models (LMs) increasingly drive real-world applications that require world knowledge. However, the internal processes through which models turn data into representations o…