Hindsight-Guided Momentum (HGM) Optimizer: An Approach to Adaptive Learning Rate

Krisanu Sarkar

We introduce Hindsight-Guided Momentum (HGM), a first-order optimization algorithm that adaptively scales learning rates based on the directional consistency of recent updates. Tra…