Faster Code, Deeper Debt? A Multivocal Literature Review on Technical Debt and Its Early Signs in LLM-Assisted Software Development
arXiv:2606.14796 · doi:10.1145/3820165
Abstract
With the rapid adoption of LLM-assisted coding, the need to manage the technical debt these systems introduce has become urgent. In this paper, we conduct a multivocal literature review of 104 sources (31 formal, 73 grey) to examine how LLM-assisted development contributes to technical debt and what strategies, metrics, and benchmarks exist to mitigate it. We find that LLMs often amplify traditional forms of technical debt, particularly code, design, and documentation debts, while also introducing new LLM-specific debts. Notably, we identify fast-integration debt, where rapidly generated code prioritizes speed over quality, triggering a domino effect that leads to governance debt and increased long-term maintenance costs. Additional emerging categories include prompt, ethical, data, and provenance debt, reflecting new challenges unique to LLM adoption. To address these, strategies suggested in the literature include human-in-the-loop frameworks, prompt engineering, and data quality alignment. In practice, tools such as SonarQube are commonly used to detect technical debt indicators, while research prototypes such as CodeSmellEval are emerging to assess how LLMs contribute to debts. However, no standardized benchmarks or LLM-specific metrics yet exist, leaving an important gap. Based on findings, we outline insights and future directions to ensure reliable integration of LLMs into software engineering workflows.
Accepted for publication in ACM Transactions on Software Engineering and Methodology (TOSEM), 2026
References in corpus (8)
- A Survey on Large Language Models for Code Generation
- Analyzing the concept of technical debt in the context of agile software development: A systematic literature review
- Technical Debt Management Automation: State of the Art and Future Perspectives
- Motivations, Challenges, Best Practices, and Benefits for Bots and Conversational Agents in Software Engineering: A Multivocal Literature Review
- PromptDebt: A Comprehensive Study of Technical Debt Across LLM Projects
- The Heap: A Contamination-Free Multilingual Code Dataset for Evaluating Large Language Models
- Do LLMs Provide Links to Code Similar to what they Generate? A Study with Gemini and Bing CoPilot
- Do Prompt Patterns Affect Code Quality? A First Empirical Assessment of ChatGPT-Generated Code