6 papers · 1 filter
Low-Latency Coded Tensor--Matrix Multiplication for Distributed Signal Processing Systems
Ahmad Tanha, Ali Khalesi
Large-scale signal processing systems, including aeronautical and aerospace platforms, increasingly rely on tensor operations, whose distributed execution is constrained by communi…
Expert Routing for Communication-Efficient MoE via Finite Expert Banks
Mohammad Reza Deylam Salehi, Ali Khalesi
Resource-efficient machine learning increasingly uses sparse Mixture-of-Experts (MoE) architectures, where the gate acts as both a learning component and a routing interface contro…
Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
Ali Khalesi, Mohammad Reza Deylam Salehi
Mixture-of-Experts (MoE) architectures decompose prediction tasks into specialized expert sub-networks selected by a gating mechanism. This letter adopts a communication-theoretic…
Wireless Broadcast Gossip for Decentralized Drone Swarms: Success Probability, Contraction, and Optimal Aloha
Ali Khalesi
We study a tractable baseline for average-preserving broadcast gossip in decentralized drone swarms under a quasi-static planar Poisson model and a matching-based abstraction. With…
Secure Multi-User Linearly-Separable Distributed Computing
Amir Masoud Jafarpisheh, Ali Khalesi, Petros Elia
The introduction of the new multi-user linearly-separable distributed computing framework, has recently revealed how a parallel treatment of users can yield large parallelization g…
Multi-User Non-Linearly Separable Distributed Computing
Ali Khalesi, Ahmad Tanha, Derya Malak +1
This paper considers an -server distributed computing setting with users requesting functions that are arbitrary multivariable polynomial evaluations of real (potentiall…