8 citations · 25 across the 12 of their papers we have counts for
4 papers · 1 filter
Derivative-Informed Training of Neural Operators On-the-Fly via Sketched Tangent Consistency
Xinhan Yang, Lu Lu, Shancong Mou
Derivative-informed training improves neural operators by directly supervising their input-output sensitivities, which is crucial when neural operators are used as differentiable s…
Natural Hypergradient Descent: Algorithm Design, Convergence Analysis, and Parallel Implementation
Deyi Kong, Zaiwei Chen, Shuzhong Zhang +1
In this work, we propose Natural Hypergradient Descent (NHGD), a new method for solving bilevel optimization problems. To address the computational bottleneck in hypergradient esti…
Synthetic Defect Generation for Display Front-of-Screen Quality Inspection: A Survey
Shancong Mou, Meng Cao, Zhendong Hong +3
Display front-of-screen (FOS) quality inspection is essential for the mass production of displays in the manufacturing process. However, the severe imbalanced data, especially the…
Stationary Behavior of Constant Stepsize SGD Type Algorithms: An Asymptotic Characterization
Zaiwei Chen, Shancong Mou, Siva Theja Maguluri
Stochastic approximation (SA) and stochastic gradient descent (SGD) algorithms are work-horses for modern machine learning algorithms. Their constant stepsize variants are preferre…