4 papers · 1 filter
MatRL: Provably Generalizable Iterative Algorithm Discovery via Monte-Carlo Tree Search
Sungyoon Kim, Rajat Vadiraj Dwaraknath, Longling geng +1
Iterative methods for computing matrix functions have been extensively studied and their convergence speed can be significantly improved with the right tuning of parameters and by…
Exploring the loss landscape of regularized neural networks via convex duality
Sungyoon Kim, Aaron Mishkin, Mert Pilanci
We discuss several aspects of the loss landscape of regularized neural networks: the structure of stationary points, connectivity of optimal solutions, path with nonincreasing loss…
Randomized Geometric Algebra Methods for Convex Neural Networks
Yifei Wang, Sungyoon Kim, Paul Chu +2
We introduce randomized algorithms to Clifford's Geometric Algebra, generalizing randomized linear algebra to hypercomplex vector spaces. This novel approach has many implications…
Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
Sungyoon Kim, Mert Pilanci
In this paper, we study the optimality gap between two-layer ReLU networks regularized with weight decay and their convex relaxations. We show that when the training data is random…