An IoT Endpoint System-on-Chip for Secure and Energy-Efficient Near-Sensor Analytics

Abstract

Near-sensor data analytics is a promising direction for IoT endpoints, as it minimizes energy spent on communication and reduces network load - but it also poses security concerns, as valuable data is stored or sent over the network at various stages of the analytics pipeline. Using encryption to protect sensitive data at the boundary of the on-chip analytics engine is a way to address data security issues. To cope with the combined workload of analytics and encryption in a tight power envelope, we propose Fulmine, a System-on-Chip based on a tightly-coupled multi-core cluster augmented with specialized blocks for compute-intensive data processing and encryption functions, supporting software programmability for regular computing tasks. The Fulmine SoC, fabricated in 65nm technology, consumes less than 20mW on average at 0.8V achieving an efficiency of up to 70pJ/B in encryption, 50pJ/px in convolution, or up to 25MIPS/mW in software. As a strong argument for real-life flexible application of our platform, we show experimental results for three secure analytics use cases: secure autonomous aerial surveillance with a state-of-the-art deep CNN consuming 3.16pJ per equivalent RISC op; local CNN-based face detection with secured remote recognition in 5.74pJ/op; and seizure detection with encrypted data collection from EEG within 12.7pJ/op.

15 pages, 12 figures, accepted for publication to the IEEE Transactions on Circuits and Systems - I: Regular Papers

References in corpus (1)

• A 128 channel Extreme Learning Machine based Neural Decoder for Brain Machine Interfaces

Cited by in corpus (10)

• The Internet of Things, Fog and Cloud Continuum: Integration and Challenges
• A 64mW DNN-based Visual Navigation Engine for Autonomous Nano-Drones
• XNOR Neural Engine: a Hardware Accelerator IP for 21.6 fJ/op Binary Neural Network Inference
• PULP-NN: Accelerating Quantized Neural Networks on Parallel Ultra-Low-Power RISC-V Processors
• DORY: Automatic End-to-End Deployment of Real-World DNNs on Low-Cost IoT MCUs
• A Guideline on Pseudorandom Number Generation (PRNG) in the IoT
• NEURAghe: Exploiting CPU-FPGA Synergies for Efficient and Flexible CNN Inference Acceleration on Zynq SoCs
• Compact recurrent neural networks for acoustic event detection on low-energy low-complexity platforms
• Unleashing OpenTitan's Potential: a Silicon-Ready Embedded Secure Element for Root of Trust and Cryptographic Offloading
• Neural Network Training on In-memory-computing Hardware with Radix-4 Gradients