Why an Android App is Classified as Malware? Towards Malware Classification Interpretation

Abstract

Machine learning (ML) based approach is considered as one of the most promising techniques for Android malware detection and has achieved high accuracy by leveraging commonly-used features. In practice, most of the ML classifications only provide a binary label to mobile users and app security analysts. However, stakeholders are more interested in the reason why apps are classified as malicious in both academia and industry. This belongs to the research area of interpretable ML but in a specific research domain (i.e., mobile malware detection). Although several interpretable ML methods have been exhibited to explain the final classification results in many cutting-edge Artificial Intelligent (AI) based research fields, till now, there is no study interpreting why an app is classified as malware or unveiling the domain-specific challenges. In this paper, to fill this gap, we propose a novel and interpretable ML-based approach (named XMal) to classify malware with high accuracy and explain the classification result meanwhile. (1) The first classification phase of XMal hinges multi-layer perceptron (MLP) and attention mechanism, and also pinpoints the key features most related to the classification result. (2) The second interpreting phase aims at automatically producing neural language descriptions to interpret the core malicious behaviors within apps. We evaluate the behavior description results by comparing with the existing interpretable ML-based methods (i.e., Drebin and LIME) to demonstrate the effectiveness of XMal. We find that XMal is able to reveal the malicious behaviors more accurately. Additionally, our experiments show that XMal can also interpret the reason why some samples are misclassified by ML classifiers. Our study peeks into the interpretable ML through the research of Android malware detection and analysis.

References in corpus (9)

• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Towards A Rigorous Science of Interpretable Machine Learning
• Methods for Interpreting and Understanding Deep Neural Networks
• Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models
• Generating Adversarial Malware Examples for Black-Box Attacks Based on GAN
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach
• Long Short-Term Memory-Networks for Machine Reading
• A Performance-Sensitive Malware Detection System Using Deep Learning on Mobile Devices
• Attention is all you need for Videos: Self-attention based Video Summarization using Universal Transformers

Cited by in corpus (4)

• A Performance-Sensitive Malware Detection System Using Deep Learning on Mobile Devices
• Deep Learning for Android Malware Defenses: a Systematic Literature Review
• Towards interpreting ML-based automated malware detection models: a survey
• Towards Interpretable Ensemble Learning for Image-based Malware Detection