14 citations · 36 across the 15 of their papers we have counts for
Showing 2022Show all
2 papers · 1 filter
cs.LG2022
On Scrambling Phenomena for Randomly Initialized Recurrent Networks
Vaggos Chatziafratis, Ioannis Panageas, Clayton Sanford +1
Recurrent Neural Networks (RNNs) frequently exhibit complicated dynamics, and their sensitivity to the initialization process often renders them notoriously hard to train. Recent w…
math.OC2022
Accelerated Multiplicative Weights Update Avoids Saddle Points almost always
Yi Feng, Ioannis Panageas, Xiao Wang
We consider non-convex optimization problems with constraint that is a product of simplices. A commonly used algorithm in solving this type of problem is the Multiplicative Weights…