2 papers
cs.LG2025
DyKAF: Dynamical Kronecker Approximation of the Fisher Information Matrix for Gradient Preconditioning
Nikolay Yudin, Ekaterina Grishina, Andrey Veprikov +2
Recently, optimizers that explicitly treat weights as matrices, rather than flattened vectors, have demonstrated their effectiveness. This perspective naturally leads to structured…
math.OC2024
New Aspects of Black Box Conditional Gradient: Variance Reduction and One Point Feedback
Andrey Veprikov, Aleksandr Bogdanov, Vladislav Minashkin +1
This paper deals with the black-box optimization problem. In this setup, we do not have access to the gradient of the objective function, therefore, we need to estimate it somehow.…