A Study of Quantisation-aware Training on Time Series Transformer Models for Resource-constrained FPGAs

Tianheng Ling, Chao Qian, Lukas Einhaus +1

This study explores the quantisation-aware training (QAT) on time series Transformer models. We propose a novel adaptive quantisation scheme that dynamically selects between symmet…