A Twin gradient method for unconstrained optimization
arXiv:2607.11575
The paper introduces a Twin‑Step gradient method that runs two parallel gradient sequences and chooses step sizes to minimize the distance between them, with a hybrid fallback to an Adaptive Barzilai‑Borwein scheme when the directions become nearly parallel.
Abstract
We propose a new strategy for gradient-based unconstrained optimization, involving two parallel sequences of iterates that cooperate to determine their stepsizes via a \textit{Twin-Step} principle. Rather than minimizing the objective function individually, the algorithm selects steplengths that minimize the Euclidean distance between the two gradient based processes occurring simultaneously at each iteration. The theoretical analysis shows that the convergence of the mutual distance is governed by the angle between the search directions. In particular the effectiveness of the overall process degrades as the directions approach parallelism. To ensure robustness against collinearity, we introduce a hybrid framework, Twin-ABB, which switches to the Adaptive Barzilai--Borwein method when the geometric cooperation becomes ineffective. Extensive and very promising numerical results evidence that the Twin phase creates favorable initial conditions for subsequent BB-type iterations.