activity
20182022
most citedGFINNs: GENERIC Formalism Informed Neural Networks for Deterministic and Stochastic Dynamical Systems

64 citations · 111 across the 5 of their papers we have counts for

collaborators
Showing 2019 · stat.MLShow all

1 paper · 2 filters

stat.ML2019

Dying ReLU and Initialization: Theory and Numerical Examples

Lu Lu, Yeonjong Shin, Yanhui Su +1

The dying ReLU refers to the problem when ReLU neurons become inactive and only output 0 for any input. There are many empirical and heuristic explanations of why ReLU neurons die.…