2 papers
cs.CL2025
Fact Recall, Heuristics or Pure Guesswork? Precise Interpretations of Language Models for Fact Completion
Denitsa Saynova, Lovisa Hagström, Moa Johansson +2
Language models (LMs) can make a correct prediction based on many possible signals in a prompt, not all corresponding to recall of factual associations. However, current interpreta…
cs.CL2025
Identifying Non-Replicable Social Science Studies with Language Models
Denitsa Saynova, Kajsa Hansson, Bastiaan Bruinsma +2
In this study, we investigate whether LLMs can be used to indicate if a study in the behavioural social sciences is replicable. Using a dataset of 14 previously replicated studies…