SpecEval: Evaluating Code Comprehension in Large Language Models via Program Specifications

Lezhi Ma, Shangqing Liu, Lei Bu +3

Large Language models have achieved impressive performance in automated software engineering. Extensive efforts have been made to evaluate the abilities of code LLMs in various asp…