436 citations · 763 across the 12 of their papers we have counts for
7 papers · 1 filter
Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-Sharing
Mikhail Khodak, Renbo Tu, Tian Li +4
Tuning hyperparameters is a crucial but arduous part of the machine learning pipeline. Hyperparameter optimization is even more challenging in federated learning, where models are…
Heterogeneity for the Win: One-Shot Federated Clustering
Don Kurian Dennis, Tian Li, Virginia Smith
In this work, we explore the unique challenges -- and opportunities -- of unsupervised federated learning (FL). We develop and analyze a one-shot federated clustering scheme, -F…
Ditto: Fair and Robust Federated Learning Through Personalization
Tian Li, Shengyuan Hu, Ahmad Beirami +1
Fairness and robustness are two important concerns for federated learning systems. In this work, we identify that robustness to data and model poisoning attacks and fairness, measu…
Tilted Empirical Risk Minimization
Tian Li, Ahmad Beirami, Maziar Sanjabi +1
Empirical risk minimization (ERM) is typically designed to perform well on the average loss, which can result in estimators that are sensitive to outliers, generalize poorly, or tr…
Privacy for Free: Communication-Efficient Learning with Differential Privacy Using Sketches
Tian Li, Zaoxing Liu, Vyas Sekar +1
Communication and privacy are two critical concerns in distributed learning. Many existing works treat these concerns separately. In this work, we argue that a natural connection e…
Enhancing the Privacy of Federated Learning with Sketching
Zaoxing Liu, Tian Li, Virginia Smith +1
In response to growing concerns about user privacy, federated learning has emerged as a promising tool to train statistical models over networks of devices while keeping data local…
Federated Optimization in Heterogeneous Networks
Tian Li, Anit Kumar Sahu, Manzil Zaheer +3
Federated Learning is a distributed learning paradigm with two key challenges that differentiate it from traditional distributed optimization: (1) significant variability in terms…