32 citations · 32 across the 2 of their papers we have counts for
4 papers
De-randomized PAC-Bayes Margin Bounds: Applications to Non-convex and Non-smooth Predictors
Arindam Banerjee, Tiancong Chen, Yingxue Zhou
In spite of several notable efforts, explaining the generalization of deterministic non-smooth deep nets, e.g., ReLU-nets, has remained challenging. Existing approaches for determi…
Hessian based analysis of SGD for Deep Nets: Dynamics and Generalization
Xinyan Li, Qilong Gu, Yingxue Zhou +2
While stochastic gradient descent (SGD) and variants have been surprisingly successful for training deep nets, several aspects of the optimization dynamics and generalization are s…
Distributed Training with Heterogeneous Data: Bridging Median- and Mean-Based Algorithms
Xiangyi Chen, Tiancong Chen, Haoran Sun +2
Recently, there is a growing interest in the study of median-based algorithms for distributed non-convex optimization. Two prominent such algorithms include signSGD with majority v…
Smooth local solutions to weingarten equations and -equations
Tiancong Chen, Qing Han
In this paper, we study the existence of smooth local solutions to Weingarten equations and -equations. We will prove that, for , the Weingarten equations and…