A Survey on Machine Learning Techniques for Source Code Analysis
arXiv:2110.09610
Abstract
The advancements in machine learning techniques have encouraged researchers to apply these techniques to a myriad of software engineering tasks that use source code analysis, such as testing and vulnerability detection. Such a large number of studies hinders the community from understanding the current research landscape. This paper aims to summarize the current knowledge in applied machine learning for source code analysis. We review studies belonging to twelve categories of software engineering tasks and corresponding machine learning techniques, tools, and datasets that have been applied to solve them. To do so, we conducted an extensive literature search and identified 479 primary studies published between 2011 and 2021. We summarize our observations and findings with the help of the identified studies. Our findings suggest that the use of machine learning techniques for source code analysis tasks is consistently increasing. We synthesize commonly used steps and the overall workflow for each task and summarize machine learning techniques employed. We identify a comprehensive list of available datasets and tools useable in this context. Finally, the paper discusses perceived challenges in this area, including the availability of standard datasets, reproducibility and replicability, and hardware resources.
References in corpus (24)
- LSTM: A Search Space Odyssey
- Survey of Machine Learning Techniques for Malware Analysis
- SequenceR: Sequence-to-Sequence Learning for End-to-End Program Repair
- Convolutional Neural Networks over Tree Structures for Programming Language Processing
- Elixir: Effective object-oriented program repair
- Deep Learning for Source Code Modeling and Generation: Models, Applications and Challenges
- A Convolutional Attention Network for Extreme Summarization of Source Code
- On the Feasibility of Transfer-learning Code Smells using Deep Learning
- On the Efficiency of Test Suite based Program Repair: A Systematic Assessment of 16 Automated Repair Systems for Java Programs
- CODIT: Code Editing with Tree-Based Neural Models
- CoaCor: Code Annotation for Code Retrieval with Reinforcement Learning
- Neural Code Comprehension: A Learnable Representation of Code Semantics
- StaQC: A Systematically Mined Question-Code Dataset from Stack Overflow
- You Autocomplete Me: Poisoning Vulnerabilities in Neural Code Completion
- Recommending Insightful Comments for Source Code using Crowdsourced Knowledge
- A parallel corpus of Python functions and documentation strings for automated code documentation and code generation
- Neural Program Repair by Jointly Learning to Localize and Repair
- A Survey of Deep Active Learning
- CodeGRU: Context-aware Deep Learning with Gated Recurrent Unit for Source Code Modeling
- Latent Attention For If-Then Program Synthesis
- Open Vocabulary Learning on Source Code with a Graph-Structured Cache
- Towards Demystifying Dimensions of Source Code Embeddings
- DARVIZ: Deep Abstract Representation, Visualization, and Verification of Deep Learning Models
- An Experience Report on Machine Learning Reproducibility: Guidance for Practitioners and TensorFlow Model Garden Contributors