3 papers
cs.LG2026
TRACE: Transformer Residual Activation Codebook Encoding for Communication-efficient Distributed Edge Inference
Muhammad Azlan Qazi, Alexandros Iosifidis, Qi Zhang
Distributed Transformer inference across co-located edge devices is fundamentally communication-bound, as exchanging activations between sequence-parallel partitions dominates infe…
cs.DC2026
Profiling-Driven Adaptive Distributed Transformer Inference on Embedded Edge Deployment
Muhammad Azlan Qazi, Alexandros Iosifidis, Qi Zhang
Distributing Transformer inference across embedded edge devices can alleviate individual memory and compute constraints, yet practical benefits on real hardware remain unclear: pri…
cs.LG2025
PRISM: Distributed Inference for Foundation Models at Edge
Muhammad Azlan Qazi, Alexandros Iosifidis, Qi Zhang
Foundation models (FMs) have achieved remarkable success across a wide range of applications, from image classification to natural langurage processing, but pose significant challe…