39 citations · 39 across the 2 of their papers we have counts for
3 papers · 1 filter
On the symmetries in the dynamics of wide two-layer neural networks
Karl Hajjar, Lenaic Chizat
We consider the idealized setting of gradient flow on the population risk for infinitely wide two-layer ReLU neural networks (without bias), and study the effect of symmetries on t…
Training Integrable Parameterizations of Deep Neural Networks in the Infinite-Width Limit
Karl Hajjar, Lénaïc Chizat, Christophe Giraud
To theoretically understand the behavior of trained deep neural networks, it is necessary to study the dynamics induced by gradient methods from a random initialization. However, t…
Ranked Reward: Enabling Self-Play Reinforcement Learning for Combinatorial Optimization
Alexandre Laterre, Yunguan Fu, Mohamed Khalil Jabri +6
Adversarial self-play in two-player games has delivered impressive results when used with reinforcement learning algorithms that combine deep neural networks and tree search. Algor…