13 citations · 17 across the 10 of their papers we have counts for
6 papers · 1 filter
The Double Descent Behavior in Two Layer Neural Network for Binary Classification
Chathurika S Abeykoon, Aleksandr Beknazaryan, Hailin Sang
Recent studies observed a surprising concept on model test error called the double descent phenomenon, where the increasing model complexity decreases the test error first and then…
Shallow neural network representation of polynomials
Aleksandr Beknazaryan
We show that -variate polynomials of degree can be represented on as shallow neural networks of width . Also, by SNN representation of localized Taylor p…
Nonparametric regression with modified ReLU networks
Aleksandr Beknazaryan, Hailin Sang
We consider regression estimation with modified ReLU neural networks in which network weight matrices are first modified by a function before being multiplied by input vectors.…
Neural networks with superexpressive activations and integer weights
Aleksandr Beknazaryan
An example of an activation function is given such that networks with activations , integer weights and a fixed architecture depending on approx…
Analytic function approximation by path norm regularized deep networks
Aleksandr Beknazaryan
We show that neural networks with absolute value activation function and with the path norm, the depth, the width and the network weights having logarithmic dependence on $1/\varep…
Function approximation by deep neural networks with parameters
Aleksandr Beknazaryan
In this paper it is shown that -smooth functions can be approximated by deep neural networks with ReLU activation function and with parameters $\{0,\pm \frac{1}{2}, \pm 1, 2\}…