Profiling-Driven Adaptive Distributed Transformer Inference on Embedded Edge Deployment

Muhammad Azlan Qazi, Alexandros Iosifidis, Qi Zhang

Distributing Transformer inference across embedded edge devices can alleviate individual memory and compute constraints, yet practical benefits on real hardware remain unclear: pri…