Quantifying Depth Sufficiency in Residual Neural Networks: A First-Order Criterion

Zeyu Liu, Jinhao Zhang, Yunquan Zhang +4

How can we determine whether a trained neural network is already deep enough? We study this under a fixed function-preserving residual-growth protocol specifying insertion location…