28 papers
Checked-In Secret Detection: Strings Are All You Need
Zhengdong Huang, Kevin Li, Jinqiu Yang +2
Hardcoded secrets in source code pose critical security vulnerabilities which can be easily exploited by malicious adversaries. Existing regex-based detection approaches suffer fro…
Preventing Premature Commitment in Coding Agents with an Evidence-Conditioned Execution Layer
Yisen Xu, Chenglin Li, Zehao Wang +2
LLM-based coding agents often edit source code or submit patches before examining enough repository evidence to justify the change, a failure pattern we call premature commitment.…
IssueTrojanBench: Benchmarking AI Coding Agents Against Malicious Issue Requests
Ankur Singh, Jinqiu Yang, Tse-Hsun Chen
AI coding agents powered by LLMs are increasingly integrated into real-world software development, where they generate, edit, and execute code with autonomous access to local files…
LLM4Log: A Systematic Review of Large Language Model-based Log Analysis
Zeyang Ma, Jinqiu Yang, Tse-Hsun Chen
Software systems generate massive, evolving, semi-structured logs that are central to reliability engineering and AIOps, yet difficult to analyze at scale under drift and limited l…
HEJ-Robust: A Robustness Benchmark for LLM-Based Automated Program Repair
Fazle Rabbi, Jinqiu Yang
Recent Large Language Models (LLMs) have shown strong performance on automated program repair across standard benchmarks. However, these benchmarks evaluate models on a single cano…
Beyond Translation Accuracy: Addressing False Failures in LLM-Based Code Translation
Fazle Rabbi, Soumit Kanti Saha, Jinqiu Yang
Large Language Models (LLMs) have achieved remarkable success in automated code translation. While prior work has focused on improving translation accuracy through advanced prompti…