On Batch Orthogonalization Layers

Blanchette, Laganière

Batch normalization has become ubiquitous in many state-of-the-art nets. It accelerates training and yields good performance results. However, there are various other alternatives…