Showing 2021Show all
2 papers · 1 filter
cs.LG2021
A Theoretical View of Linear Backpropagation and Its Convergence
Ziang Li, Yiwen Guo, Haodi Liu +1
Backpropagation (BP) is widely used for calculating gradients in deep neural networks (DNNs). Applied often along with stochastic gradient descent (SGD) or its variants, BP is cons…
cs.LG2021
Learned ISTA with Error-based Thresholding for Adaptive Sparse Coding
Ziang Li, Kailun Wu, Yiwen Guo +1
Drawing on theoretical insights, we advocate an error-based thresholding (EBT) mechanism for learned ISTA (LISTA), which utilizes a function of the layer-wise reconstruction error…