Exploiting Layerwise Convexity of Rectifier Networks with Sign Constrained Weights

Senjian An, Farid Boussaid, Mohammed Bennamoun +1

By introducing sign constraints on the weights, this paper proposes sign constrained rectifier networks (SCRNs), whose training can be solved efficiently by the well known majoriza…