5 papers
OpenCodeReview: Determinism over Non-Determinism for Cost-Effective Agent-Based Code Review
Zhengfeng Li, Lei Zhang, Xianwei Wu +8
LLM-based code review agents promise scalable, always-on review, yet current systems suffer from two intertwined weaknesses: (1) non-determinism--unbounded tool use makes review ou…
ConceptRM: The Quest to Mitigate Alert Fatigue through Consensus-Based Purity-Driven Data Cleaning for Reflection Modelling
Yongda Yu, Lei Zhang, Xinxin Guo +9
In many applications involving intelligent agents, the overwhelming volume of alerts (mostly false) generated by the agents may desensitize users and cause them to overlook critica…
AACR-Bench: Evaluating Automatic Code Review with Holistic Repository-Level Context
Lei Zhang, Yongda Yu, Minghui Yu +11
High-quality evaluation benchmarks are pivotal for deploying Large Language Models (LLMs) in Automated Code Review (ACR). However, existing benchmarks suffer from two critical limi…
AUCAD: Automated Construction of Alignment Dataset from Log-Related Issues for Enhancing LLM-based Log Generation
Hao Zhang, Dongjun Yu, Lei Zhang +6
Log statements have become an integral part of modern software systems. Prior research efforts have focused on supporting the decisions of placing log statements, such as where/wha…
Distilling Desired Comments for Enhanced Code Review with Large Language Models
Yongda Yu, Lei Zhang, Guoping Rong +9
There has been a growing interest in using Large Language Models (LLMs) for code review thanks to their proven proficiency in code comprehension. The primary objective of most revi…