3 papers
cs.LG2022
Normalization effects on deep neural networks
Jiahui Yu, Konstantinos Spiliopoulos
We study the effect of normalization on the layers of deep neural networks of feed-forward type. A given layer with hidden units is allowed to be normalized by $1/N_{i}…
stat.ML2020
Normalization effects on shallow neural networks and related asymptotic expansions
Jiahui Yu, Konstantinos Spiliopoulos
We consider shallow (single hidden layer) neural networks and characterize their performance when trained with stochastic gradient descent as the number of hidden units and gra…
math.ST2019
Smoothing Spline Semiparametric Density Models
Jian Shi, Jiahui Yu, Anna Liu +1
Density estimation plays a fundamental role in many areas of statistics and machine learning. Parametric, nonparametric and semiparametric density estimation methods have been prop…