64 citations · 115 across the 18 of their papers we have counts for
4 papers · 1 filter
A Generic Shared Attention Mechanism for Various Backbone Neural Networks
Zhongzhan Huang, Senwei Liang, Mingfu Liang +1
The self-attention mechanism has emerged as a critical component for improving the performance of various backbone neural networks. However, current mainstream approaches individua…
On Fast Simulation of Dynamical System with Neural Vector Enhanced Numerical Solver
Zhongzhan Huang, Senwei Liang, Hong Zhang +2
The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of…
The Lottery Ticket Hypothesis for Self-attention in Convolutional Neural Network
Zhongzhan Huang, Senwei Liang, Mingfu Liang +3
Recently many plug-and-play self-attention modules (SAMs) are proposed to enhance the model generalization by exploiting the internal information of deep convolutional neural netwo…
Finite Expression Method for Solving High-Dimensional Partial Differential Equations
Senwei Liang, Haizhao Yang
Designing efficient and accurate numerical solvers for high-dimensional partial differential equations (PDEs) remains a challenging and important topic in computational science and…