activity
20172023
most citedFedPAQ: A Communication-Efficient Federated Learning Method with Periodic Averaging and Quantization

336 citations · 1.1k across the 77 of their papers we have counts for

collaborators
Showing 2023Show all

12 papers · 1 filter

cs.LG2023★ 6 cited

Share Your Representation Only: Guaranteed Improvement of the Privacy-Utility Tradeoff in Federated Learning

Zebang Shen, Jiayuan Ye, Anmin Kang +2

Repeated parameter sharing in federated learning causes significant information leakage about private data, thus defeating its main purpose: data privacy. Mitigating the risk of th…

cs.LG2023

Min-Max Optimization under Delays

Arman Adibi, Aritra Mitra, Hamed Hassani

Delays and asynchrony are inevitable in large-scale machine-learning problems where communication plays a key role. As such, several works have extensively analyzed stochastic opti…

cs.LG2023★ 8 cited

Text + Sketch: Image Compression at Ultra Low Rates

Eric Lei, Yiğit Berkay Uslu, Hamed Hassani +1

Recent advances in text-to-image generative models provide the ability to generate high-quality images from short text descriptions. These foundation models, when pre-trained on bi…

cs.LG2023

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks

Liam Collins, Hamed Hassani, Mahdi Soltanolkotabi +2

An increasingly popular machine learning paradigm is to pretrain a neural network (NN) on many tasks offline, then adapt it to downstream tasks, often by re-training only the last…

cs.IT2023

On a Relation Between the Rate-Distortion Function and Optimal Transport

Eric Lei, Hamed Hassani, Shirin Saeedi Bidokhti

We discuss a relationship between rate-distortion and optimal transport (OT) theory, even though they seem to be unrelated at first glance. In particular, we show that a function d…

cs.LG2023★ 4 cited

Adversarial Training Should Be Cast as a Non-Zero-Sum Game

Alexander Robey, Fabian Latorre, George J. Pappas +2

One prominent approach toward resolving the adversarial vulnerability of deep neural networks is the two-player zero-sum paradigm of adversarial training, in which predictors are t…

stat.ML2023★ 3 cited

Optimal Multitask Linear Regression and Contextual Bandits under Sparse Heterogeneity

Xinmeng Huang, Kan Xu, Donghwan Lee +3

Large and complex datasets are often collected from several, possibly heterogeneous sources. Multitask learning methods improve efficiency by leveraging commonalities across datase…

cs.LG2023

Federated Neural Compression Under Heterogeneous Data

Eric Lei, Hamed Hassani, Shirin Saeedi Bidokhti

We discuss a federated learned compression problem, where the goal is to learn a compressor from real-world data which is scattered across clients and may be statistically heteroge…

eess.SY2023

Performance-Robustness Tradeoffs in Adversarially Robust Control and Estimation

Bruce D. Lee, Thomas T. C. K. Zhang, Hamed Hassani +1

While methods can introduce robustness against worst-case perturbations, their nominal performance under conventional stochastic disturbances is often drastica…

stat.ML2023

Demystifying Disagreement-on-the-Line in High Dimensions

Donghwan Lee, Behrad Moniri, Xinmeng Huang +2

Evaluating the performance of machine learning models under distribution shift is challenging, especially when we only have unlabeled data from the shifted (target) domain, along w…

cs.LG2023★ 6 cited

Federated Temporal Difference Learning with Linear Function Approximation under Environmental Heterogeneity

Han Wang, Aritra Mitra, Hamed Hassani +2

We initiate the study of federated reinforcement learning under environmental heterogeneity by considering a policy evaluation problem. Our setup involves agents interacting wi…

cs.LG2023★ 3 cited

Temporal Difference Learning with Compressed Updates: Error-Feedback meets Reinforcement Learning

Aritra Mitra, George J. Pappas, Hamed Hassani

In large-scale distributed machine learning, recent works have studied the effects of compressing gradients in stochastic optimization to alleviate the communication bottleneck. Th…