2 papers
cs.SE2024
PPM: Automated Generation of Diverse Programming Problems for Benchmarking Code Generation Models
Simin Chen, Xiaoning Feng, Xiaohong Han +2
In recent times, a plethora of Large Code Generation Models (LCGMs) have been proposed, showcasing significant potential in assisting developers with complex programming tasks. Ben…
cs.SE2024
Uncertainty Awareness of Large Language Models Under Code Distribution Shifts: A Benchmark Study
Yufei Li, Simin Chen, Yanghong Guo +3
Large Language Models (LLMs) have been widely employed in programming language analysis to enhance human productivity. Yet, their reliability can be compromised by various code dis…