Towards Better Orthogonality Regularization with Disentangled Norm in Training Deep CNNs

Changhao Wu, Shenan Zhang, Fangsong Long +2

Orthogonality regularization has been developed to prevent deep CNNs from training instability and feature redundancy. Among existing proposals, kernel orthogonality regularization…