4 papers
AgentGuard: A Multi-Agent Framework for Robust Package Confusion Detection via Hybrid Search and Metadata-Content Fusion
Yu Li, Wei Ma, Zhi Chen +6
The proliferation of open-source software (OSS) has made software supply chains prime targets for attacks like Package Confusion, where adversaries publish malicious packages with…
VulnRepairEval: An Exploit-Based Evaluation Framework for Assessing Large Language Model Vulnerability Repair Capabilities
Weizhe Wang, Wei Ma, Qiang Hu +6
The adoption of Large Language Models (LLMs) for automated software vulnerability patching has shown promising outcomes on carefully curated evaluation sets. Nevertheless, existing…
Improving Code Understanding in Large Language Models through Concept-Aware Consistency Learning
Xiaoning Ren, Qiang Hu, Wei Ma +6
Large language models (LLMs) have recently shown impressive results on diverse code-related tasks, benefiting from large-scale training and instruction tuning. However, studies rev…
Importance Sampling is All You Need: Predict LLM's performance on new benchmark by reusing existing benchmark
Junjie Shi, Wei Ma, Shi Ying +3
With the rapid advancement of large language models , code generation has become a key benchmark for evaluating LLM capabilities. However, existing benchmarks face two major challe…