Path Analysis for Effective Fault Localization in Deep Neural Networks

Abstract

Deep learning has revolutionized numerous fields, yet the reliability of Deep Neural Networks (DNNs) remains a concern due to their complexity and data dependency. Traditional software fault localization methods, such as Spectrum-based Fault Localization (SBFL), have been adapted for DNNs but often fall short in effectiveness. These methods typically overlook the propagation of faults through neural pathways, resulting in less precise fault detection. Research indicates that examining neural pathways, rather than individual neurons, is crucial because issues in one neuron can affect its entire pathway. By investigating these interconnected pathways, we can better identify and address problems arising from the collective activity of neurons. To address this limitation, we introduce the NP-SBFL method, which leverages Layer-wise Relevance Propagation (LRP) to identify essential faulty neural pathways. Our method explores multiple fault sources to accurately pinpoint faulty neurons by analyzing their interconnections. Additionally, our multi-stage gradient ascent (MGA) technique, an extension of gradient ascent (GA), enables sequential neuron activation to enhance fault detection. We evaluated NP-SBFL-MGA on the well-established MNIST and CIFAR-10 datasets, comparing it to other methods like DeepFault and NP-SBFL-GA, as well as three neuron measures: Tarantula, Ochiai, and Barinel. Our evaluation utilized all training and test samples (60,000 for MNIST and 50,000 for CIFAR-10) and revealed that NP-SBFL-MGA significantly outperformed the baselines in identifying suspicious pathways and generating adversarial inputs. Notably, Tarantula with NP-SBFL-MGA achieved a remarkable 96.75% fault detection rate compared to DeepFault's 89.90%. NP-SBFL-MGA highlights a strong correlation between critical path coverage and the number of failed tests in DNN fault localization.

References in corpus (13)

• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Understanding Neural Networks Through Deep Visualization
• DeepXplore: Automated Whitebox Testing of Deep Learning Systems
• DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
• Visualizing Deep Convolutional Neural Networks Using Natural Pre-Images
• "What is Relevant in a Text Document?": An Interpretable Machine Learning Approach
• Neural Trojans
• Testing Deep Neural Networks
• Arachne: Search Based Repair of Deep Neural Networks
• DeepFD: Automated Fault Diagnosis and Localization for Deep Learning Programs
• An Effective Data-Driven Approach for Localizing Deep Learning Faults
• Repairing Deep Neural Networks Based on Behavior Imitation
• FetaFix: Automatic Fault Localization and Repair of Deep Learning Model Conversions