activity
20172022
most citedCheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group

86 citations · 133 across the 6 of their papers we have counts for

collaborators
Showing 2019Show all

2 papers · 1 filter

cs.LG2019★ 36 cited

Trivializations for Gradient-Based Optimization on Manifolds

Mario Lezcano-Casado

We introduce a framework to study the transformation of problems with manifold constraints into unconstrained problems through parametrizations in terms of a Euclidean space. We ca…

cs.LG2019★ 86 cited

Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Group

Mario Lezcano-Casado, David Martínez-Rubio

We introduce a novel approach to perform first-order optimization with orthogonal and unitary constraints. This approach is based on a parametrization stemming from Lie group theor…