2 papers
cs.LG2021
A Projection Algorithm for the Unitary Weights
Hao-Yuan Chang
Unitary neural networks are promising alternatives for solving the exploding and vanishing activation/gradient problem without the need for explicit normalization that reduces the…
cs.LG2021
Deep Unitary Convolutional Neural Networks
Hao-Yuan Chang, Kang L. Wang
Deep neural networks can suffer from the exploding and vanishing activation problem, in which the networks fail to train properly because the neural signals either amplify or atten…