14 papers
Low-Latency Coded Tensor--Matrix Multiplication for Distributed Signal Processing Systems
Ahmad Tanha, Ali Khalesi
Large-scale signal processing systems, including aeronautical and aerospace platforms, increasingly rely on tensor operations, whose distributed execution is constrained by communi…
Expert Routing for Communication-Efficient MoE via Finite Expert Banks
Mohammad Reza Deylam Salehi, Ali Khalesi
Resource-efficient machine learning increasingly uses sparse Mixture-of-Experts (MoE) architectures, where the gate acts as both a learning component and a routing interface contro…
Mixture-of-Experts under Finite-Rate Gating: Communication--Generalization Trade-offs
Ali Khalesi, Mohammad Reza Deylam Salehi
Mixture-of-Experts (MoE) architectures decompose prediction tasks into specialized expert sub-networks selected by a gating mechanism. This letter adopts a communication-theoretic…
Wireless Broadcast Gossip for Decentralized Drone Swarms: Success Probability, Contraction, and Optimal Aloha
Ali Khalesi
We study a tractable baseline for average-preserving broadcast gossip in decentralized drone swarms under a quasi-static planar Poisson model and a matching-based abstraction. With…
Secure Multi-User Linearly-Separable Distributed Computing
Amir Masoud Jafarpisheh, Ali Khalesi, Petros Elia
The introduction of the new multi-user linearly-separable distributed computing framework, has recently revealed how a parallel treatment of users can yield large parallelization g…
Multi-User Non-Linearly Separable Distributed Computing
Ali Khalesi, Ahmad Tanha, Derya Malak +1
This paper considers an -server distributed computing setting with users requesting functions that are arbitrary multivariable polynomial evaluations of real (potentiall…
Typical Solutions of Multi-User Linearly-Decomposable Distributed Computing
Ali Khalesi, Mohammad Reza Deylam Salehi
We solve, in the typical-case sense, the multi-sender linearly-decomposable distributed computing problem introduced by tessellated distributed computing. We model real-valued enco…
General Multi-User Distributed Computing: A Learning-Theoretic RKHS Framework for Generic Nonlinear Target Functions with Topology-Aware Risk Analysis
Ali Khalesi
This paper studies multi-user distributed computation over shared real-valued subfunctions under computation and communication constraints. We consider a \emph{General Multi-User D…
The Distributed Multi-User Point Function
Ali Khalesi, Bahareh Akhbari
In this paper, we study the problem of information-theoretic distributed multi-user point function, involving a trusted master node, server nodes, and $K\in \mat…
Tessellated Distributed Computing
Ali Khalesi, Petros Elia
The work considers the -server distributed computing scenario with users requesting functions that are linearly-decomposable over an arbitrary basis of real (potentially…
Perfect Multi-User Distributed Computing
Ali Khalesi, Petros Elia
In this paper, we investigate the problem of multi-user linearly decomposable function computation, where servers help compute functions for users, and where each such func…
Multi-User Distributed Computing Via Compressed Sensing
Ali Khalesi, Sajad Daei, Marios Kountouris +1
The multi-user linearly-separable distributed computing problem is considered here, in which servers help to compute the real-valued functions requested by users, where eac…
Multi-User Linearly-Separable Distributed Computing
Ali Khalesi, Petros Elia
In this work, we explore the problem of multi-user linearly-separable distributed computation, where servers help compute the desired functions (jobs) of users, and where e…
The Capacity Region of Distributed Multi-User Secret Sharing
Ali Khalesi, Mahtab Mirmohseni, Mohammad Ali Maddah-Ali
In this paper, we study the problem of distributed multi-user secret sharing, including a trusted master node, storage nodes, and users, where each user has a…