99 citations · 260 across the 15 of their papers we have counts for
7 papers · 1 filter
Embracing Federated Learning: Enabling Weak Client Participation via Partial Model Training
Sunwoo Lee, Tuo Zhang, Saurav Prakash +2
In Federated Learning (FL), clients may have weak devices that cannot train the full model or even hold it in their memory space. To implement large-scale FL applications, thus, it…
ATP: Enabling Fast LLM Serving via Attention on Top Principal Keys
Yue Niu, Saurav Prakash, Salman Avestimehr
We propose a new attention mechanism with linear complexity, ATP, that fixates \textbf{A}ttention on \textbf{T}op \textbf{P}rincipal keys, rather than on each individual token. Par…
Federated Classification in Hyperbolic Spaces via Secure Aggregation of Convex Hulls
Saurav Prakash, Jin Sima, Chao Pan +2
Hierarchical and tree-like data sets arise in many applications, including language processing, graph data mining, phylogeny and genomics. It is known that tree-like data cannot be…
Machine Unlearning of Federated Clusters
Chao Pan, Jin Sima, Saurav Prakash +2
Federated clustering (FC) is an unsupervised learning problem that arises in a number of practical applications, including personalized recommender and healthcare systems. With the…
Federated Learning of Large Models at the Edge via Principal Sub-Model Training
Yue Niu, Saurav Prakash, Souvik Kundu +2
Federated Learning (FL) is emerging as a popular, promising decentralized learning framework that enables collaborative training among clients, with no need to share private data b…
Lottery Aware Sparsity Hunting: Enabling Federated Learning on Resource-Limited Edge
Sara Babakniya, Souvik Kundu, Saurav Prakash +2
Edge devices can benefit remarkably from federated learning due to their distributed nature; however, their limited resource and computing power poses limitations in deployment. A…
Coded Federated Learning
Sagar Dhakal, Saurav Prakash, Yair Yona +2
Federated learning is a method of training a global model from decentralized data distributed across client devices. Here, model parameters are computed locally by each client devi…