Fast Transformer Inference on ARM-Based HMPSoCs

Hang Xu, Yixian Shen, Thanassis Giannetsos +1

Transformer models have set new performance standards for machine learning (ML) tasks. However, their resource-intensive deployment on resource-constrained edge devices for cloud-f…