339 citations · 392 across the 14 of their papers we have counts for
4 papers · 1 filter
Local SGD Optimizes Overparameterized Neural Networks in Polynomial Time
Yuyang Deng, Mohammad Mahdi Kamani, Mehrdad Mahdavi
In this paper we prove that Local (S)GD (or FedAvg) can optimize deep neural networks with Rectified Linear Unit (ReLU) activation function in polynomial time. Despite the establis…
CAT: Cross-Attention Transformer for One-Shot Object Detection
Weidong Lin, Yuyan Deng, Yang Gao +5
Given a query patch from a novel class, one-shot object detection aims to detect all instances of that class in a target image through the semantic similarity comparison. However,…
Local Stochastic Gradient Descent Ascent: Convergence Analysis and Communication Efficiency
Yuyang Deng, Mehrdad Mahdavi
Local SGD is a promising approach to overcome the communication overhead in distributed learning by reducing the synchronization frequency among worker nodes. Despite the recent th…
Distributionally Robust Federated Averaging
Yuyang Deng, Mohammad Mahdi Kamani, Mehrdad Mahdavi
In this paper, we study communication efficient distributed algorithms for distributionally robust federated learning via periodic averaging with adaptive sampling. In contrast to…