61 citations · 125 across the 16 of their papers we have counts for
7 papers · 1 filter
A More Stable Accelerated Gradient Method Inspired by Continuous-Time Perspective
Yasong Feng, Weiguo Gao
Nesterov's accelerated gradient method (NAG) is widely used in problems with machine learning background including deep learning, and is corresponding to a continuous-time differen…
SOFT: Softmax-free Transformer with Linear Complexity
Jiachen Lu, Jinghan Yao, Junge Zhang +6
Vision transformers (ViTs) have pushed the state-of-the-art for various visual recognition tasks by patch-wise image tokenization followed by self-attention. However, the employmen…
Global Convergence of Triangularized Orthogonalization-free Method
Weiguo Gao, Yingzhou Li, Bichen Lu
This paper proves the global convergence of a triangularized orthogonalization-free method (TriOFM). TriOFM, in general, applies a triangularization idea to the gradient of an obje…
A Diversity-Enhanced and Constraints-Relaxed Augmentation for Low-Resource Classification
Guang Liu, Hailong Huang, Yuzhao Mao +3
Data augmentation (DA) aims to generate constrained and diversified data to improve classifiers in Low-Resource Classification (LRC). Previous studies mostly use a fine-tuned Langu…
Adversarial Mixing Policy for Relaxing Locally Linear Constraints in Mixup
Guang Liu, Yuzhao Mao, Hailong Huang +2
Mixup is a recent regularizer for current deep classification networks. Through training a neural network on convex combinations of pairs of examples and their labels, it imposes l…
Blind super-resolution of point sources via fast iterative hard thresholding
Zengying Zhu, Jinchi Chen, Weiguo Gao
In this work, we develop a provable fast algorithm for blind super-resolution based on the low rank structure of vectorized Hankel matrix associated with the target matrix. Theoret…
Stability and Super-resolution of MUSIC and ESPRIT for Multi-snapshot Spectral Estimation
Weilin Li, Zengying Zhu, Weiguo Gao +1
This paper studies the spectral estimation problem of estimating the locations of a fixed number of point sources given multiple snapshots of Fourier measurements collected by a un…