4 papers
Acoda: Adversarial Code Obfuscation for Defending against LLM-based Analysis
Hongzhou Rao, Zikan Dong, Yanjie Zhao +2
With the widespread adoption of Large Language Models (LLMs) in software engineering (SE) tasks such as code understanding, debugging, and vulnerability detection, their powerful s…
Evaluating and Enhancing the Vulnerability Reasoning Capabilities of Large Language Models
Li Lu, Yanjie Zhao, Hongzhou Rao +2
Large Language Models (LLMs) have demonstrated remarkable proficiency in vulnerability detection. However, a critical reliability gap persists: models frequently yield correct dete…
Software Engineering for Large Language Models: Research Status, Challenges and the Road Ahead
Hongzhou Rao, Yanjie Zhao, Xinyi Hou +2
The rapid advancement of large language models (LLMs) has redefined artificial intelligence (AI), pushing the boundaries of AI research and enabling unbounded possibilities for bot…
CodeMorph: Mitigating Data Leakage in Large Language Model Assessment
Hongzhou Rao, Yanjie Zhao, Wenjie Zhu +3
Concerns about benchmark leakage in large language models for code (Code LLMs) have raised issues of data contamination and inflated evaluation metrics. The diversity and inaccessi…