4 papers · 1 filter
When Code Becomes an LLM Call: An Empirical Study of Call-Site Contracts in Agentic Systems
Shihao Weng, Longtian Wang, Yang Feng +6
Software quality has long rested on specifications that state what code must do, and on testing and verification that check that the code does it. Agentic systems change this found…
AutoEmpirical: LLM-Based Automated Research for Empirical Software Fault Analysis
Jiongchi Yu, Weipeng Jiang, Xiaoyu Zhang +3
Understanding software faults is essential for empirical research in software development and maintenance. However, traditional fault analysis, while valuable, typically involves m…
The Foundation Cracks: A Comprehensive Study on Bugs and Testing Practices in LLM Libraries
Weipeng Jiang, Xiaoyu Zhang, Xiaofei Xie +4
Large Language Model (LLM) libraries have emerged as the foundational infrastructure powering today's AI revolution, serving as the backbone for LLM deployment, inference optimizat…
Benchmarking and Revisiting Code Generation Assessment: A Mutation-Based Approach
Longtian Wang, Tianlin Li, Xiaofei Xie +3
Code Large Language Models (CLLMs) have exhibited outstanding performance in program synthesis, attracting the focus of the research community. The evaluation of CLLM's program syn…