EXAdam: The Power of Adaptive Cross-Moments

Ahmed M. Adly

This paper introduces EXAdam ($\text{EX}$tended $\text{Adam}$), a novel optimization algorithm that builds upon the widely-used Adam optimizer. EXAdam incorporates two key enha…