4 papers
Memorization or Interpolation ? Detecting LLM Memorization through Input Perturbation Analysis
Albérick Euraste Djiré, Abdoul Kader Kaboré, Earl T. Barr +2
While Large Language Models (LLMs) achieve remarkable performance through training on massive datasets, they can exhibit concerning behaviors such as verbatim reproduction of train…
Polymer: Development Workflows as Software
Dhasarathy Parthasarathy, Yinan Yu, Earl T. Barr
Software development builds digital tools to automate processes, yet its initial phases, up to deployment, remain largely manual. There are two reasons: Development tasks are often…
To Err is Machine: Vulnerability Detection Challenges LLM Reasoning
Benjamin Steenhoek, Md Mahbubur Rahman, Monoshi Kumar Roy +5
In this paper, we present a challenging code reasoning task: vulnerability detection. Large Language Models (LLMs) have shown promising results in natural-language and math reasoni…
Practitioners' Expectations on Log Anomaly Detection
Xiaoxue Ma, Yishu Li, Jacky Keung +5
Log anomaly detection has become a common practice for software engineers to analyze software system behavior. Despite significant research efforts in log anomaly detection over th…