CoFormer: Collaborating with Heterogeneous Edge Devices for Scalable Transformer Inference

Guanyu Xu, Zhiwei Hao, Li Shen +5

The impressive performance of transformer models has sparked the deployment of intelligent applications on resource-constrained edge devices. However, ensuring high-quality service…