1 citations · 1 across the 2 of their papers we have counts for
3 papers
cond-mat.dis-nn2025
Phase diagram and eigenvalue dynamics of stochastic gradient descent in multilayer neural networks
Chanju Park, Biagio Lucini, Gert Aarts
Hyperparameter tuning is one of the essential steps to guarantee the convergence of machine learning models. We argue that intuition about the optimal choice of hyperparameters for…
hep-lat2024
Random Matrix Theory for Stochastic Gradient Descent
Chanju Park, Matteo Favoni, Biagio Lucini +1
Investigating the dynamics of learning in machine learning algorithms is of paramount importance for understanding how and why an approach may be successful. The tools of physics a…
cond-mat.dis-nn2024★ 1 cited
Dyson Brownian motion and random matrix dynamics of weight matrices during learning
Gert Aarts, Ouraman Hajizadeh, Biagio Lucini +1
During training, weight matrices in machine learning architectures are updated using stochastic gradient descent or variations thereof. In this contribution we employ concepts of r…