Deep Network Trainability via Persistent Subspace Orthogonality

Alex Massucco, Davide Murari, Carola-Bibiane Schönlieb

Training neural networks via backpropagation is often hindered by vanishing or exploding gradients. In this work, we design architectures that mitigate these issues by analyzing an…