activity
20182024
most citedA Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent

5 citations · 15 across the 8 of their papers we have counts for

collaborators

8 papers

cond-mat.soft2024

Periodic Cylindrical Bilayers Self-Assembled from Diblock Polymers

Yongshun Luo, Min Yang, Sirui Li +2

Amphiphilic polymers in aqueous solutions can self-assemble to form bilayer membranes, and their elastic properties can be captured by the well-known Helfrich model involving sever…

cs.LG2023★ 3 cited

Minimum Width of Leaky-ReLU Neural Networks for Uniform Universal Approximation

Li'ang Li, Yifei Duan, Guanghua Ji +1

The study of universal approximation properties (UAP) for neural networks (NN) has a long history. When the network width is unlimited, only a single hidden layer is sufficient for…

cs.LG2023★ 2 cited

Vocabulary for Universal Approximation: A Linguistic Perspective of Mapping Compositions

Yongqiang Cai

In recent years, deep learning-based sequence modelings, such as language models, have received much attention and success, which pushes researchers to explore the possibility of t…

cs.LG2022★ 4 cited

Achieve the Minimum Width of Neural Networks for Universal Approximation

Yongqiang Cai

The universal approximation property (UAP) of neural networks is fundamental for deep learning, and it is well known that wide neural networks are universal approximators of contin…

cs.LG2022

Vanilla Feedforward Neural Networks as a Discretization of Dynamical Systems

Yifei Duan, Li'ang Li, Guanghua Ji +1

Deep learning has made significant applications in the field of data science and natural science. Some studies have linked deep neural networks to dynamic systems, but the network…

physics.app-ph2020★ 1 cited

Machine learning and high-throughput robust design of P3HT-CNT composite thin films for high electrical conductivity

Daniil Bash, Yongqiang Cai, Vijila Chellappan +16

Combining high-throughput experiments with machine learning allows quick optimization of parameter spaces towards achieving target properties. In this study, we demonstrate that ma…

cs.LG2020

Optimization in Machine Learning: A Distribution Space Approach

Yongqiang Cai, Qianxiao Li, Zuowei Shen

We present the viewpoint that optimization problems encountered in machine learning can often be interpreted as minimizing a convex functional over a function space, but with a non…

cs.LG2018★ 5 cited

A Quantitative Analysis of the Effect of Batch Normalization on Gradient Descent

Yongqiang Cai, Qianxiao Li, Zuowei Shen

Despite its empirical success and recent theoretical progress, there generally lacks a quantitative analysis of the effect of batch normalization (BN) on the convergence and stabil…