Towards Energy-Efficient and Secure Edge AI: A Cross-Layer Framework

Abstract

The security and privacy concerns along with the amount of data that is required to be processed on regular basis has pushed processing to the edge of the computing systems. Deploying advanced Neural Networks (NN), such as deep neural networks (DNNs) and spiking neural networks (SNNs), that offer state-of-the-art results on resource-constrained edge devices is challenging due to the stringent memory and power/energy constraints. Moreover, these systems are required to maintain correct functionality under diverse security and reliability threats. This paper first discusses existing approaches to address energy efficiency, reliability, and security issues at different system layers, i.e., hardware (HW) and software (SW). Afterward, we discuss how to further improve the performance (latency) and the energy efficiency of Edge AI systems through HW/SW-level optimizations, such as pruning, quantization, and approximation. To address reliability threats (like permanent and transient faults), we highlight cost-effective mitigation techniques, like fault-aware training and mapping. Moreover, we briefly discuss effective detection and protection techniques to address security threats (like model and data corruption). Towards the end, we discuss how these techniques can be combined in an integrated cross-layer framework for realizing robust and energy-efficient Edge AI systems.

To appear at the 40th IEEE/ACM International Conference on Computer-Aided Design (ICCAD), November 2021, Virtual Event

References in corpus (13)

• Neural Architecture Search with Reinforcement Learning
• Deep Learning with Limited Numerical Precision
• CryptoDL: Deep Neural Networks over Encrypted Data
• Hardware and Software Optimizations for Accelerating Deep Neural Networks: Survey of Current Trends, Challenges, and the Road Ahead
• Towards the Science of Security and Privacy in Machine Learning
• Robust Machine Learning Systems: Challenges, Current Trends, Perspectives, and the Road Ahead
• Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attacks
• Q-SpiNN: A Framework for Quantizing Spiking Neural Networks
• DeepAPT: Nation-State APT Attribution Using End-to-End Deep Neural Networks
• ReSpawn: Energy-Efficient Fault-Tolerance for Spiking Neural Networks considering Unreliable Memories
• Securing Deep Spiking Neural Networks against Adversarial Attacks through Inherent Structural Parameters
• SparkXD: A Framework for Resilient and Energy-Efficient Spiking Neural Network Inference using Approximate DRAM
• CapsAttacks: Robust and Imperceptible Adversarial Attacks on Capsule Networks

Cited by in corpus (10)

• EnforceSNN: Enabling Resilient and Energy-Efficient Spiking Neural Network Inference considering Approximate DRAMs for Embedded Systems
• Embodied Neuromorphic Artificial Intelligence for Robotics: Perspectives, Challenges, and Research Development Stack
• lpSpikeCon: Enabling Low-Precision Spiking Neural Network Processing for Efficient Unsupervised Continual Learning on Autonomous Agents
• A Homomorphic Encryption Framework for Privacy-Preserving Spiking Neural Networks
• RoHNAS: A Neural Architecture Search Framework with Conjoint Optimization for Adversarial Robustness and Hardware Efficiency of Convolutional and Capsule Networks
• SpikeNAS: A Fast Memory-Aware Neural Architecture Search Framework for Spiking Neural Network-based Embedded AI Systems
• Mantis: Enabling Energy-Efficient Autonomous Mobile Agents with Spiking Neural Networks
• A Methodology to Study the Impact of Spiking Neural Network Parameters considering Event-Based Automotive Data
• Special Session: Towards an Agile Design Methodology for Efficient, Reliable, and Secure ML Systems
• SpikeVox: Towards Energy-Efficient Speech Therapy Framework with Spike-driven Generative Language Models