An Empirical Study of Obsolete Answers on Stack Overflow

Abstract

Stack Overflow accumulates an enormous amount of software engineering knowledge. However, as time passes, certain knowledge in answers may become obsolete. Such obsolete answers, if not identified or documented clearly, may mislead answer seekers and cause unexpected problems (e.g., using an out-dated security protocol). In this paper, we investigate how the knowledge in answers becomes obsolete and identify the characteristics of such obsolete answers. We find that: 1) More than half of the obsolete answers (58.4%) were probably already obsolete when they were first posted. 2) When an obsolete answer is observed, only a small proportion (20.5%) of such answers are ever updated. 3) Answers to questions in certain tags (e.g., node.js, ajax, android, and objective-c) are more likely to become obsolete. Our findings suggest that Stack Overflow should develop mechanisms to encourage the whole community to maintain answers (to avoid obsolete answers) and answer seekers are encouraged to carefully go through all information (e.g., comments) in answer threads.

arXiv comment14 pages

References in corpus (3)

• Toxic Code Snippets on Stack Overflow
• Want a Good Answer? Ask a Good Question First!
• Awareness and Experience of Developers to Outdated and License-Violating Code on Stack Overflow: An Online Survey

Cited by in corpus (11)

• An empirical study of question discussions on Stack Overflow
• Broken External Links on Stack Overflow
• Are Human Rules Necessary? Generating Reusable APIs with CoT Reasoning and In-Context Learning
• A Study of Update Request Comments in Stack Overflow Answer Posts
• Automatic API Usage Scenario Documentation from Technical Q&A Sites
• Software Engineers' Questions and Answers on Stack Exchange
• On Using Stack Overflow Comment-Edit Pairs to recommend code maintenance changes
• An Empirical Study on the Characteristics of Question-Answering Process on Developer Forums
• On the Feasibility of Predicting Questions being Forgotten in Stack Overflow
• An Exploratory Study on the Repeatedly Shared External Links on Stack Overflow
• Does the hiding mechanism for Stack Overflow comments work well? No!