3 citations · 4 across the 9 of their papers we have counts for
7 papers · 1 filter
The Flow-Limit of Reflect-Reflect-Relax: Existence, Stability, and Discrete-Time Behavior
Manish Krishan Lal
We study the Reflect-Reflect-Relax (RRR) algorithm in its small-step (flow-limit) regime. In the smooth transversal setting, we show that the transverse dynamics form a hyperbolic…
Backpropagation from KL Projections: Differential and Exact I-Projection Correspondences
Manish Krishan Lal
We establish two correspondences between reverse-mode automatic differentiation (backpropagation at a given forward-pass point) and compositions of projection maps in Kullback--Lei…
Real roots of real cubics and optimization
Heinz H. Bauschke, Manish Krishan Lal, Xianfu Wang
The solution of the cubic equation has a century-long history; however, the usual presentation is geared towards applications in algebra and is somewhat inconvenient to use in opti…
Projecting onto rectangular hyperbolic paraboloids in Hilbert space
Heinz H. Bauschke, Manish Krishan Lal, Xianfu Wang
In , a hyperbolic paraboloid is a classical saddle-shaped quadric surface. Recently, Elser has modeled problems arising in Deep Learning using rectangular hyperbolic…
Projections onto hyperbolas or bilinear constraint sets in Hilbert spaces
Heinz H. Bauschke, Manish Krishan Lal, Xianfu Wang
Sets of bilinear constraints are important in various machine learning models. Mathematically, they are hyperbolas in a product space. In this paper, we give a complete formula for…
The projection onto the cross
Heinz H. Bauschke, Manish Krishan Lal, Xianfu Wang
We consider the set of pairs of orthogonal vectors in Hilbert space, which is also called the cross because it is the union of the horizontal and vertical axes in the Euclidean pla…
Directional asymptotics of Fejér monotone sequences
Heinz H. Bauschke, Manish Krishan Lal, Xianfu Wang
The notion of Fejér monotonicity is instrumental in unifying the convergence proofs of many iterative methods, such as the Krasnoselskii-Mann iteration, the proximal point method,…