3 citations · 6 across the 5 of their papers we have counts for
Showing stat.MLShow all
2 papers · 1 filter
stat.ML2022★ 2 cited
Convergence of neural networks to Gaussian mixture distribution
Yasuhiko Asao, Ryotaro Sakamoto, Shiro Takagi
We give a proof that, under relatively mild conditions, fully-connected feed-forward deep random neural networks converge to a Gaussian mixture distribution as only the width of th…
stat.ML2021
Statistical Mechanical Analysis of Catastrophic Forgetting in Continual Learning with Teacher and Student Networks
Haruka Asanuma, Shiro Takagi, Yoshihiro Nagano +3
When a computational system continuously learns from an ever-changing environment, it rapidly forgets its past experiences. This phenomenon is called catastrophic forgetting. While…