Transformers predicting the future. Applying attention in next-frame and time series forecasting

Radostin Cholakov, Todor Kolev

Recurrent Neural Networks were, until recently, one of the best ways to capture the timely dependencies in sequences. However, with the introduction of the Transformer, it has been…