2 citations · 2 across the 1 of their papers we have counts for
1 paper · 1 filter
Lu Lu, Yeonjong Shin, Yanhui Su +1
The dying ReLU refers to the problem when ReLU neurons become inactive and only output 0 for any input. There are many empirical and heuristic explanations of why ReLU neurons die.…