Non-monotone Behavior of the Heavy Ball Method

Marina Danilova, Anastasiya Kulakova, Boris Polyak

We focus on the solutions of second-order stable linear difference equations and demonstrate that their behavior can be non-monotone and exhibit peak effects depending on initial c…