Unit-Consistent (UC) Adjoint for GSD and Backprop in Deep Learning Applications

Jeffrey Uhlmann

Deep neural networks constructed from linear maps and positively homogeneous nonlinearities (e.g., ReLU) possess a fundamental gauge symmetry: the network function is invariant to…