39 citations · 88 across the 8 of their papers we have counts for
Showing 2024Show all
2 papers · 1 filter
cs.AI2024★ 3 cited
SciCode: A Research Coding Benchmark Curated by Scientists
Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang +27
Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evalua…
cs.SE2024★ 5 cited
CodeMind: Evaluating Large Language Models for Code Reasoning
Changshu Liu, Yang Chen, Reyhaneh Jabbarvand
Large Language Models (LLMs) have been widely used to automate programming tasks. Their capabilities have been evaluated by assessing the quality of generated code through tests or…