2 papers
stat.ML2020
Banach Space Representer Theorems for Neural Networks and Ridge Splines
Rahul Parhi, Robert D. Nowak
We develop a variational framework to understand the properties of the functions learned by neural networks fit to data. We propose and study a family of continuous-domain linear i…
stat.ML2019
The Role of Neural Network Activation Functions
Rahul Parhi, Robert D. Nowak
A wide variety of activation functions have been proposed for neural networks. The Rectified Linear Unit (ReLU) is especially popular today. There are many practical reasons that m…