Beyond Accuracy: Characterizing Code Comprehension Capabilities in (Large) Language Models

Felix Mächtle, Jan-Niclas Serr, Nils Loose +1

Large Language Models (LLMs) are increasingly integrated into software engineering workflows, yet current benchmarks provide only coarse performance summaries that obscure the dive…