Showing cs.CLShow all
2 papers · 1 filter
cs.CL2026
Where Animacy Lives in Large Language Models: Tracing the Circuits of the Animacy Concept
Samuele Punzo, Giovanni CinÃ, Sandro Pezzelle
Distinguishing animate from inanimate concepts in written language requires more than shallow text processing, as it involves recognizing complex selectional constraints and contex…
cs.CL2026
Is my model perplexed for the right reason? Contrasting LLMs' Benchmark Behavior with Token-Level Perplexity
Zoë Prins, Samuele Punzo, Frank Wildenburg +2
Standard evaluations of Large language models (LLMs) focus on task performance, offering limited insight into whether correct behavior reflects appropriate underlying mechanisms an…