activity
20182026
most citedDrop-Activation: Implicit Parameter Reduction and Harmonic Regularization

5 citations · 5 across the 5 of their papers we have counts for

collaborators

6 papers

cs.LG2026

Accelerated Learning of High Dimensional Functions with a Tensor-Featured Training Network

Karl Pierce, Yuehaw Khoo, Haizhao Yang

In this work we present a method to accelerate the optimization of learning high dimensional functions using deep neural network (DNN). This optimization procedure introduces conte…

math.OC2026

Global Convergence and Error Propagation in Neural Gradient Flows: A Riemannian Optimization Framework

Shixin Zheng, Yiwei Wang, Haizhao Yang

We develop a geometric convergence theory for neural-network optimization within the minimizing movement scheme (MMS) framework. Reformulating each neural MMS step as a minimizatio…

math.NA2025

Multi-Scale Finite Expression Method for PDEs with Oscillatory Solutions on Complex Domains

Gareth Hardwick, Haizhao Yang

Solving partial differential equations (PDEs) with highly oscillatory solutions on complex domains remains a challenging and important problem. High-frequency oscillations and intr…

math.NA2024

Solving High-Dimensional Partial Integral Differential Equations: The Finite Expression Method

Gareth Hardwick, Senwei Liang, Haizhao Yang

In this paper, we introduce a new finite expression method (FEX) to solve high-dimensional partial integro-differential equations (PIDEs). This approach builds upon the original FE…

cs.CE2022

On Fast Simulation of Dynamical System with Neural Vector Enhanced Numerical Solver

Zhongzhan Huang, Senwei Liang, Hong Zhang +2

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of…

cs.LG2018★ 5 cited

Drop-Activation: Implicit Parameter Reduction and Harmonic Regularization

Senwei Liang, Yuehaw Khoo, Haizhao Yang

Overfitting frequently occurs in deep learning. In this paper, we propose a novel regularization method called Drop-Activation to reduce overfitting and improve generalization. The…