Grouped self-attention mechanism for a memory-efficient Transformer

Bumjun Jung, Yusuke Mukuta, Tatsuya Harada

Time-series data analysis is important because numerous real-world tasks such as forecasting weather, electricity consumption, and stock market involve predicting data that vary ov…