13 papers
GapForge: Directed Compiler Fuzzing via Coverage-Gap Analysis
Mingxuan Zhu, Qingyuan Liang, Junjie Chen +2
Modern compiler codebases (e.g., GCC and LLVM) are large and complex, making comprehensive coverage across diverse code regions highly challenging. Most existing test generation te…
Contextualized Code Pretraining for Code Generation
Chen Liu, Qingyuan Liang, Hanwen Zhang +3
As code generation becomes increasingly central to improving software development efficiency, modern code models are largely trained and evaluated on code with natural-language des…
TRACE: Evaluating Execution Efficiency of LLM-Based Code Translation
Zhihao Gong, Zeyu Sun, Dong Huang +3
While Large Language Models (LLMs) have substantially improved the functional correctness of code translation, the critical dimension of \textit{execution efficiency} remains overl…
Toward Functional and Non-Functional Evaluation of Application-Level Code Generation
Ruwei Pan, Yakun Zhang, Qingyuan Liang +4
Large language models (LLMs) have achieved strong performance on code generation. However, most prior evaluations focus on snippet-level outputs, such as function generation or rep…
TRACE: Evaluating Execution Efficiency of LLM-Based Code Translation
Zhihao Gong, Zeyu Sun, Dong Huang +3
While Large Language Models (LLMs) have substantially improved the functional correctness of code translation, the critical dimension of \textit{execution efficiency} remains overl…
Contamination Means Overestimation? A Fine-Grained Empirical Study in Code Intelligence
Zhen Yang, Hongyi Lin, Yifan He +7
In recent years, code intelligence has gained increasing importance in the field of automated software engineering. Meanwhile, the widespread adoption of Pretrained Language Models…