8 papers
Wireless Broadcast Gossip for Decentralized Drone Swarms: Success Probability, Contraction, and Optimal Aloha
Ali Khalesi
We study a tractable baseline for average-preserving broadcast gossip in decentralized drone swarms under a quasi-static planar Poisson model and a matching-based abstraction. With…
Expert Routing for Communication-Efficient MoE via Finite Expert Banks
Mohammad Reza Deylam Salehi, Ali Khalesi
Resource-efficient machine learning increasingly uses sparse Mixture-of-Experts (MoE) architectures, where the gate acts as both a learning component and a routing interface contro…
Multi-User Non-Linearly Separable Distributed Computing
Ali Khalesi, Ahmad Tanha, Derya Malak +1
This paper considers an -server distributed computing setting with users requesting functions that are arbitrary multivariable polynomial evaluations of real (potentiall…
Secure Multi-User Linearly-Separable Distributed Computing
Amir Masoud Jafarpisheh, Ali Khalesi, Petros Elia
The introduction of the new multi-user linearly-separable distributed computing framework, has recently revealed how a parallel treatment of users can yield large parallelization g…
General Multi-User Distributed Computing: A Learning-Theoretic RKHS Framework for Generic Nonlinear Target Functions with Topology-Aware Risk Analysis
Ali Khalesi
This paper studies multi-user distributed computation over shared real-valued subfunctions under computation and communication constraints. We consider a \emph{General Multi-User D…
Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
Ali Khalesi, Mohammad Reza Deylam Salehi
Mixture-of-Experts (MoE) architectures decompose prediction tasks into specialized expert sub-networks selected by a gating mechanism. This letter adopts a communication-theoretic…