86 citations · 477 across the 43 of their papers we have counts for
52 papers
Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD
Yijun Wan, Melih Barsbey, Abdellatif Zaidi +1
Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explici…
Lessons from Generalization Error Analysis of Federated Learning: You May Communicate Less Often!
Milad Sefidgaran, Romain Chor, Abdellatif Zaidi +1
We investigate the generalization error of statistical learning models in a Federated Learning (FL) setting. Specifically, we study the evolution of the generalization error with t…
More Communication Does Not Result in Smaller Generalization Error in Federated Learning
Romain Chor, Milad Sefidgaran, Abdellatif Zaidi
We study the generalization error of statistical learning models in a Federated Learning (FL) setting. Specifically, there are devices or clients, each holding an independent o…
Data-dependent Generalization Bounds via Variable-Size Compressibility
Milad Sefidgaran, Abdellatif Zaidi
In this paper, we establish novel data-dependent upper bounds on the generalization error through the lens of a "variable-size compressibility" framework that we introduce newly he…
Rate-Distortion Theoretic Bounds on Generalization Error for Distributed Learning
Milad Sefidgaran, Romain Chor, Abdellatif Zaidi
In this paper, we use tools from rate-distortion theory to establish new upper bounds on the generalization error of statistical distributed learning algorithms. Specifically, ther…
Rate-Exponent Region for a Class of Distributed Hypothesis Testing Against Conditional Independence Problems
Abdellatif Zaidi
We study a class of -encoder hypothesis testing against conditional independence problems. Under the criterion that stipulates minimization of the Type II error subject to a (co…