1 citations · 2 across the 3 of their papers we have counts for
1 paper · 1 filter
Kexin Li, Wenjun Qiu, Joshua Abraham +2
Rectified linear unit (ReLU) networks can suffer from dying neurons, where units with persistently negative pre-activations produce zero outputs, blocking gradients through their a…