Deep Learning Techniques for Compressive Sensing-Based Reconstruction and Inference -- A Ubiquitous Systems Perspective

Abstract

Compressive sensing (CS) is a mathematically elegant tool for reducing the sampling rate, potentially bringing context-awareness to a wider range of devices. Nevertheless, practical issues with the sampling and reconstruction algorithms prevent further proliferation of CS in real world domains, especially among heterogeneous ubiquitous devices. Deep learning (DL) naturally complements CS for adapting the sampling matrix, reconstructing the signal, and learning form the compressed samples. While the CS-DL integration has received substantial research interest recently, it has not yet been thoroughly surveyed, nor has the light been shed on practical issues towards bringing the CS-DL to real world implementations in the ubicomp domain. In this paper we identify main possible ways in which CS and DL can interplay, extract key ideas for making CS-DL efficient, identify major trends in CS-DL research space, and derive guidelines for future evolution of CS-DL within the ubicomp domain.

References in corpus (29)

• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Message Passing Algorithms for Compressed Sensing
• A Survey of Model Compression and Acceleration for Deep Neural Networks
• Generalized Orthogonal Matching Pursuit
• Tensorizing Neural Networks
• AMP-Inspired Deep Networks for Sparse Linear Inverse Problems
• DR2-Net: Deep Residual Reconstruction Network for Image Compressive Sensing
• SPINN: Synergistic Progressive Inference of Neural Networks over Device and Cloud
• Trainable ISTA for Sparse Signal Recovery
• Slimmable Neural Networks
• Learned D-AMP: Principled Neural Network based Compressive Image Recovery
• Deep Residual Learning for Compressed Sensing CT Reconstruction via Persistent Homology Analysis
• Deep Generative Adversarial Networks for Compressed Sensing Automates MRI
• Distributed Compressive Sensing: A Deep Learning Approach
• ADMM-Net: A Deep Learning Approach for Compressive Sensing MRI
• Compressed Learning: A Deep Neural Network Approach
• Compressed Domain Image Classification Using a Dynamic-Rate Neural Network
• Deep De-Aliasing for Fast Compressive Sensing MRI
• A Deep Learning Approach to Block-based Compressed Sensing of Images
• Exploiting Restricted Boltzmann Machines and Deep Belief Networks in Compressed Sensing
• Uncertainty Autoencoders: Learning Compressed Representations via Variational Information Maximization
• Exploiting Local Structures with the Kronecker Layer in Convolutional Networks
• ConvCSNet: A Convolutional Compressive Sensing Framework Based on Deep Learning
• Application of Compressive Sensing Techniques in Distributed Sensor Networks: A Survey
• CSVideoNet: A Real-time End-to-end Learning Framework for High-frame-rate Video Compressive Sensing
• Real-time Dynamic MRI Reconstruction using Stacked Denoising Autoencoder
• Rate-Adaptive Neural Networks for Spatial Multiplexers
• Deep Learning of Compressed Sensing Operators with Structural Similarity Loss
• Learning Fast Approximations of Sparse Nonlinear Regression