18 papers
Not as Sweet by Another Name: An Empirical Study of Format Robustness in LLM Document Workflows
Xiaoyu Zhang, Xianyun Cheng, Tianlin Li +3
The paper investigates how changing document formats (e.g., CSV vs. plain text) affects the reliability of end-to-end LLM-driven software workflows, introducing a metamorphic testi…
Rethinking Technology Stack Selection with AI Coding Proficiency
Xiaoyu Zhang, Weipeng Jiang, Shiqing Ma +5
Large language models (LLMs) are now an integral part of software development workflows and are reshaping the whole process. However, existing technology selection methods mainly f…
Fairness Testing of Large Language Models in Role-Playing
Xinyue Li, Zhenpeng Chen, Jie M. Zhang +6
Large Language Models (LLMs) have become foundational in modern language-driven software applications, profoundly influencing daily life. A critical technique in leveraging their p…
How Emotion Shapes the Behavior of LLMs and Agents: A Mechanistic Study
Moran Sun, Tianlin Li, Yuwei Zheng +4
Emotion plays an important role in human cognition and performance. Motivated by this, we investigate whether analogous emotional signals can shape the behavior of large language m…
Software Development Life Cycle Perspective: A Survey of Benchmarks for Code Large Language Models and Agents
Kaixin Wang, Tianlin Li, Xiaoyu Zhang +7
Code large language models (CodeLLMs) and agents are increasingly being integrated into complex software engineering tasks spanning the entire Software Development Life Cycle (SDLC…
ODAR: Principled Adaptive Routing for LLM Reasoning via Active Inference
Siyuan Ma, Bo Gao, Xiaojun Jia +6
The paradigm of large language model (LLM) reasoning is shifting from parameter scaling to test-time compute scaling, yet many existing approaches still rely on uniform brute-force…