FT-CNN: Algorithm-Based Fault Tolerance for Convolutional Neural Networks

Abstract

Convolutional neural networks (CNNs) are becoming more and more important for solving challenging and critical problems in many fields. CNN inference applications have been deployed in safety-critical systems, which may suffer from soft errors caused by high-energy particles, high temperature, or abnormal voltage. Of critical importance is ensuring the stability of the CNN inference process against soft errors. Traditional fault tolerance methods are not suitable for CNN inference because error-correcting code is unable to protect computational components, instruction duplication techniques incur high overhead, and existing algorithm-based fault tolerance (ABFT) techniques cannot protect all convolution implementations. In this paper, we focus on how to protect the CNN inference process against soft errors as efficiently as possible, with the following three contributions. (1) We propose several systematic ABFT schemes based on checksum techniques and analyze their fault protection ability and runtime thoroughly.Unlike traditional ABFT based on matrix-matrix multiplication, our schemes support any convolution implementations. (2) We design a novel workflow integrating all the proposed schemes to obtain a high detection/correction ability with limited total runtime overhead. (3) We perform our evaluation using ImageNet with well-known CNN models including AlexNet, VGG-19, ResNet-18, and YOLOv2. Experimental results demonstrate that our implementation can handle soft errors with very limited runtime overhead (4%~8% in both error-free and error-injected situations).

arXiv comment13 pages

References in corpus (8)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• TensorFlow: A system for large-scale machine learning
• cuDNN: Efficient Primitives for Deep Learning
• An Analysis of ISO 26262: Using Machine Learning Safely in Automotive Software
• DeepSZ: A Novel Framework to Compress Deep Neural Networks by Using Error-Bounded Lossy Compression
• Improving Performance of Iterative Methods by Lossy Checkponting
• TSM2X: High-Performance Tall-and-Skinny Matrix-Matrix Multiplication on GPUs
• Fault Tolerance in Iterative-Convergent Machine Learning

Cited by in corpus (8)

• Anatomy of High-Performance GEMM with Online Fault Tolerance on GPUs
• A Survey on Deep Domain Adaptation and Tiny Object Detection Challenges, Techniques and Datasets
• Arithmetic-Intensity-Guided Fault Tolerance for Neural Network Inference on GPUs
• Towards a Safety Case for Hardware Fault Tolerance in Convolutional Neural Networks Using Activation Range Supervision
• RA-BNN: Constructing Robust & Accurate Binary Neural Network to Simultaneously Defend Adversarial Bit-Flip Attack and Improve Accuracy
• Efficient Soft-Error Detection for Low-precision Deep Learning Recommendation Models
• HyCA: A Hybrid Computing Architecture for Fault Tolerant Deep Learning
• R2F: A Remote Retraining Framework for AIoT Processors with Computing Errors