A Novel Active Learning Approach to Label One Million Unknown Malware Variants

Abstract

Active learning for classification seeks to reduce the cost of labeling samples by finding unlabeled examples about which the current model is least certain and sending them to an annotator/expert to label. Bayesian theory can provide a probabilistic view of deep neural network models by asserting a prior distribution over model parameters and estimating the uncertainties by posterior distribution over these parameters. This paper proposes two novel active learning approaches to label one million malware examples belonging to different unknown modern malware families. The first model is Inception-V4+PCA combined with several support vector machine (SVM) algorithms (UTSVM, PSVM, SVM-GSU, TBSVM). The second model is Vision Transformer based Bayesian Neural Networks ViT-BNN. Our proposed ViT-BNN is a state-of-the-art active learning approach that differs from current methods and can apply to any particular task. The experiments demonstrate that the ViT-BNN is more stable and robust in handling uncertainty.

References in corpus (6)

• A Survey of Malware Detection Using Deep Learning
• CNN-LSTM and Transfer Learning Models for Malware Classification based on Opcodes and API Calls
• Deep Multi-Task Learning for Malware Image Classification
• Linear Maximum Margin Classifier for Learning from Uncertain Data
• Optimized detection of cyber-attacks on IoT networks via hybrid deep learning models
• A near-autonomous and incremental intrusion detection system through active learning of known and unknown attacks