Norm-Constrained Flows and Sign-Based Optimization: Theory and Algorithms

Valentin Leplat, Sergio Mayorga, Roland Hildebrand +1

Sign Gradient Descent (SignGD) uses only the coordinate-wise sign of the gradient. We study this method through norm-constrained continuous-time dynamics: at each point, the veloci…