102 citations · 102 across the 7 of their papers we have counts for
Showing 2022 · cs.LGShow all
3 papers · 2 filters
cs.LG2022
Magnitude and Angle Dynamics in Training Single ReLU Neurons
Sangmin Lee, Byeongsu Sim, Jong Chul Ye
To understand learning the dynamics of deep ReLU networks, we investigate the dynamic system of gradient flow by decomposing it to magnitude and angle $ϕ(t):= π- θ(t)…
cs.LG2022★ 102 cited
Improving Diffusion Models for Inverse Problems using Manifold Constraints
Hyungjin Chung, Byeongsu Sim, Dohoon Ryu +1
Recently, diffusion models have been used to solve various inverse problems in an unsupervised manner with appropriate modifications to the sampling process. However, the current s…
cs.LG2022
Support Vectors and Gradient Dynamics of Single-Neuron ReLU Networks
Sangmin Lee, Byeongsu Sim, Jong Chul Ye
Understanding implicit bias of gradient descent for generalization capability of ReLU networks has been an important research topic in machine learning research. Unfortunately, eve…