Certifying Residual Architectures from Their Primitives: Growth Exponents and Criticality

Hyemin Gu, Michael Tyrrell, Tuhin Sahai +1

Whether a deep residual architecture avoids numerical blow-up in its forward and backward dynamics is typically determined through costly trial-and-error training. Existing stabili…