1 citations · 1 across the 6 of their papers we have counts for
5 papers · 1 filter
Generalized Convexity and Smoothness via Conjugate Duality, with Applications to Deep Network Training
Binchuan Qi
Stochastic gradient descent (SGD) and its variants train deep neural networks (DNNs) effectively in practice, yet classical optimization theory does not fully explain this success:…
Towards Understanding the Optimization Mechanisms in Deep Learning
Binchuan Qi, Wei Gong, Li Li
In this paper, we adopt a probability distribution estimation perspective to explore the optimization mechanisms of supervised classification using deep neural networks. We demonst…
Extended convexity and smoothness and their applications in deep learning
Binchuan Qi, Wei Gong, Li Li
Classical assumptions like strong convexity and Lipschitz smoothness often fail to capture the nature of deep learning optimization problems, which are typically non-convex and non…
Probability Distribution Learning and Its Application in Deep Learning
Binchuan Qi, Wei Gong, Li Li
Despite its empirical success, deep learning still lacks a comprehensive theoretical understanding of model fitting and generalization. This paper proposes the probability distribu…
Error Bounds of Supervised Classification from Information-Theoretic Perspective
Binchuan Qi
In this paper, we explore bounds on the expected risk when using deep neural networks for supervised classification from an information theoretic perspective. Firstly, we introduce…