4 papers · 1 filter
Evaluating LLM-Based 0-to-1 Software Generation in End-to-End CLI Tool Scenarios
Ruida Hu, Xinchen Wang, Chao Peng +2
The evolution of Large Language Models (LLMs) has catalyzed a paradigm shift towards intent-driven software development, where autonomous agents are expected to design and deliver…
Benchmarking Large Language Models for Multi-Language Software Vulnerability Detection
Ting Zhang, Chengran Yang, Yindu Su +8
Recent advancements in generative AI have led to the widespread adoption of large language models (LLMs) in software engineering, addressing numerous long-standing challenges. Howe…
ACECode: A Reinforcement Learning Framework for Aligning Code Efficiency and Correctness in Code Language Models
Chengran Yang, Hong Jin Kang, Jieke Shi +1
CodeLLMs have demonstrated remarkable advancements in software engineering tasks. However, while these models can generate functionally correct code, they often produce code that i…
VulEval: Towards Repository-Level Evaluation of Software Vulnerability Detection
Xin-Cheng Wen, Xinchen Wang, Yujia Chen +3
Deep Learning (DL)-based methods have proven to be effective for software vulnerability detection, with a potential for substantial productivity enhancements for detecting vulnerab…