Orthogonal and Idempotent Transformations for Learning Deep Neural Networks

Jingdong Wang, Yajie Xing, Kexin Zhang +1

Identity transformations, used as skip-connections in residual networks, directly connect convolutional layers close to the input and those close to the output in deep neural netwo…