2 papers
cs.SE2024
PPM: Automated Generation of Diverse Programming Problems for Benchmarking Code Generation Models
Simin Chen, Xiaoning Feng, Xiaohong Han +2
In recent times, a plethora of Large Code Generation Models (LCGMs) have been proposed, showcasing significant potential in assisting developers with complex programming tasks. Ben…
cs.CL2022
LLMEffiChecker: Understanding and Testing Efficiency Degradation of Large Language Models
Xiaoning Feng, Xiaohong Han, Simin Chen +1
In this paper, we make the first attempt to understand and test potential computation efficiency robustness in state-of-the-art LLMs. By analyzing the working mechanism and impleme…