3.4k citations · 27.2k across the 213 of their papers we have counts for
Showing 2019 · stat.MLShow all
2 papers · 2 filters
stat.ML2019★ 15 cited
Quantifying the generalization error in deep learning in terms of data distribution and neural network smoothness
Pengzhan Jin, Lu Lu, Yifa Tang +1
The accuracy of deep learning, i.e., deep neural networks, can be characterized by dividing the total error into three main types: approximation error, optimization error, and gene…
stat.ML2019★ 282 cited
Dying ReLU and Initialization: Theory and Numerical Examples
Lu Lu, Yeonjong Shin, Yanhui Su +1
The dying ReLU refers to the problem when ReLU neurons become inactive and only output 0 for any input. There are many empirical and heuristic explanations of why ReLU neurons die.…