354 citations · 693 across the 36 of their papers we have counts for
18 papers · 1 filter
Multi-Server Secure Aggregation with Unreliable Communication Links
Kai Liang, Songze Li, Ming Ding +1
In many distributed learning setups such as federated learning (FL), client nodes at the edge use individually collected data to compute local gradients and send them to a central…
Coded Distributed Computing for Hierarchical Multi-task Learning
Haoyang Hu, Songze Li, Minquan Cheng +1
In this paper, we consider a hierarchical distributed multi-task learning (MTL) system where distributed users wish to jointly learn different models orchestrated by a central serv…
Information-Theoretically Private Matrix Multiplication From MDS-Coded Storage
Jinbao Zhu, Songze Li, Jie Li
We study two problems of private matrix multiplication, over a distributed computing system consisting of a master node, and multiple servers that collectively store a family of pu…
SwiftAgg+: Achieving Asymptotically Optimal Communication Loads in Secure Aggregation for Federated Learning
Tayyebeh Jahani-Nezhad, Mohammad Ali Maddah-Ali, Songze Li +1
We propose SwiftAgg+, a novel secure aggregation protocol for federated learning systems, where a central server aggregates local models of distributed users, ea…
SwiftAgg: Communication-Efficient and Dropout-Resistant Secure Aggregation for Federated Learning with Worst-Case Security Guarantees
Tayyebeh Jahani-Nezhad, Mohammad Ali Maddah-Ali, Songze Li +1
We propose SwiftAgg, a novel secure aggregation protocol for federated learning systems, where a central server aggregates local models of distributed users, each of size ,…
A Systematic Approach towards Efficient Private Matrix Multiplication
Jinbao Zhu, Songze Li
We consider the problems of Private and Secure Matrix Multiplication (PSMM) and Fully Private Matrix Multiplication (FPMM), for which matrices privately selected by a master node a…
Symmetric Private Polynomial Computation From Lagrange Encoding
Jinbao Zhu, Qifa Yan, Xiaohu Tang +1
The problem of -secure -colluding symmetric Private Polynomial Computation (PPC) from coded storage system with Byzantine and unresponsive servers is studied in this…
Coded State Machine -- Scaling State Machine Execution under Byzantine Faults
Songze Li, Saeid Sahraei, Mingchao Yu +3
We introduce an information-theoretic framework, named Coded State Machine (CSM), to securely and efficiently execute multiple state machines on untrusted network nodes, some of wh…
Polynomially Coded Regression: Optimal Straggler Mitigation via Data Encoding
Songze Li, Seyed Mohammadreza Mousavi Kalan, Qian Yu +2
We consider the problem of training a least-squares regression model on a large dataset using gradient descent. The computation is carried out on a distributed system consisting of…
Compressed Coded Distributed Computing
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
Communication overhead is one of the major performance bottlenecks in large-scale distributed computing systems, in particular for machine learning applications. Conventionally, co…
Near-Optimal Straggler Mitigation for Distributed Gradient Methods
Songze Li, Seyed Mohammadreza Mousavi Kalan, A. Salman Avestimehr +1
Modern learning algorithms use gradient descent updates to train inferential models that best explain data. Scaling these approaches to massive data sizes requires proper distribut…
Communication-Aware Computing for Edge Processing
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
We consider a mobile edge computing problem, in which mobile users offload their computation tasks to computing nodes (e.g., base stations) at the network edge. The edge nodes comp…
How to Optimally Allocate Resources for Coded Distributed Computing?
Qian Yu, Songze Li, Mohammad Ali Maddah-Ali +1
Today's data centers have an abundance of computing resources, hosting server clusters consisting of as many as tens or hundreds of thousands of machines. To execute a complex comp…
Coding for Distributed Fog Computing
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
Redundancy is abundant in Fog networks (i.e., many computing and storage points) and grows linearly with network size. We demonstrate the transformational role of coding in Fog com…
A Unified Coding Framework for Distributed Computing with Straggling Servers
Songze Li, Mohammad Ali Maddah-Ali, A. Salman Avestimehr
We propose a unified coded framework for distributed computing with straggling servers, by introducing a tradeoff between "latency of computation" and "load of communication" for s…
A Scalable Framework for Wireless Distributed Computing
Songze Li, Qian Yu, Mohammad Ali Maddah-Ali +1
We consider a wireless distributed computing system, in which multiple mobile users, connected wirelessly through an access point, collaborate to perform a computation task. In par…
A Fundamental Tradeoff between Computation and Communication in Distributed Computing
Songze Li, Mohammad Ali Maddah-Ali, Qian Yu +1
How can we optimally trade extra computing power to reduce the communication load in distributed computing? We answer this question by characterizing a fundamental tradeoff between…
Rover-to-Orbiter Communication in Mars: Taking Advantage of the Varying Topology
Songze Li, David T. H. Kao, A. Salman Avestimehr
In this paper, we study the communication problem from rovers on Mars' surface to Mars-orbiting satellites. We first justify that, to a good extent, the rover-to-orbiter communicat…