38 citations · 64 across the 8 of their papers we have counts for
4 papers · 1 filter
On the Equivalence between Implicit and Explicit Neural Networks: A High-dimensional Viewpoint
Zenan Ling, Zhenyu Liao, Robert C. Qiu
Implicit neural networks have demonstrated remarkable success in various tasks. However, there is a lack of theoretical analysis of the connections and differences between implicit…
A Roadmap for Big Model
Sha Yuan, Hanyu Zhao, Shuai Zhao +97
With the rapid development of deep learning, training Big Models (BMs) for multiple downstream tasks becomes a popular paradigm. Researchers have achieved various outcomes in the c…
Optimization Induced Equilibrium Networks
Xingyu Xie, Qiuhao Wang, Zenan Ling +4
Implicit equilibrium models, i.e., deep neural networks (DNNs) defined by implicit equations, have been becoming more and more attractive recently. In this paper, we investigate an…
Spectrum concentration in deep residual learning: a free probability approach
Zenan Ling, Xing He, Robert C. Qiu
We revisit the initialization of deep residual networks (ResNets) by introducing a novel analytical tool in free probability to the community of deep learning. This tool deals with…