R3Net: Random Weights, Rectifier Linear Units and Robustness for Artificial Neural Network

Arun Venkitaraman, Alireza M. Javid, Saikat Chatterjee

We consider a neural network architecture with randomized features, a sign-splitter, followed by rectified linear units (ReLU). We prove that our architecture exhibits robustness t…