Multilinear Compressive Learning
arXiv:1905.07481 · doi:10.1109/TNNLS.2020.2984831
Abstract
Compressive Learning is an emerging topic that combines signal acquisition via compressive sensing and machine learning to perform inference tasks directly on a small number of measurements. Many data modalities naturally have a multi-dimensional or tensorial format, with each dimension or tensor mode representing different features such as the spatial and temporal information in video sequences or the spatial and spectral information in hyperspectral images. However, in existing compressive learning frameworks, the compressive sensing component utilizes either random or learned linear projection on the vectorized signal to perform signal acquisition, thus discarding the multi-dimensional structure of the signals. In this paper, we propose Multilinear Compressive Learning, a framework that takes into account the tensorial nature of multi-dimensional signals in the acquisition step and builds the subsequent inference model on the structurally sensed measurements. Our theoretical complexity analysis shows that the proposed framework is more efficient compared to its vector-based counterpart in both memory and computation requirement. With extensive experiments, we also empirically show that our Multilinear Compressive Learning framework outperforms the vector-based framework in object classification and face recognition tasks, and scales favorably when the dimensionalities of the original signals increase, making it highly efficient for high-dimensional multi-dimensional signals.
accepted in IEEE Transactions on Neural Networks and Learning Systems 2020
References in corpus (14)
- Adam: A Method for Stochastic Optimization
- Striving for Simplicity: The All Convolutional Net
- Exploiting Linear Structure Within Convolutional Networks for Efficient Evaluation
- Tensor Decompositions for Signal Processing Applications From Two-way to Multiway Component Analysis
- Speeding up Convolutional Neural Networks with Low Rank Expansions
- Speeding-up Convolutional Neural Networks Using Fine-tuned CP-Decomposition
- CryptoDL: Deep Neural Networks over Encrypted Data
- Temporal Attention augmented Bilinear Network for Financial Time-Series Data Analysis
- Tensor-Train Recurrent Neural Networks for Video Classification
- Compressed Learning: A Deep Neural Network Approach
- Compressed Domain Image Classification Using a Dynamic-Rate Neural Network
- Tensor Representation in High-Frequency Financial Data for Price Change Prediction
- Improving Efficiency in Convolutional Neural Network with Multilinear Filters
- Multilinear Class-Specific Discriminant Analysis