3 papers
cs.DC2025
UniFormer: Unified and Efficient Transformer for Reasoning Across General and Custom Computing
Zhuoheng Ran, Chong Wu, Renjie Xu +2
The success of neural networks such as convolutional neural networks (CNNs) has been largely attributed to their effective and widespread deployment on customised computing platfor…
math.NA2025
sparseGeoHOPCA: A Geometric Solution to Sparse Higher-Order PCA Without Covariance Estimation
Renjie Xu, Chong Wu, Maolin Che +3
We propose sparseGeoHOPCA, a novel framework for sparse higher-order principal component analysis (SHOPCA) that introduces a geometric perspective to high-dimensional tensor decomp…
eess.IV2025
ELFATT: Efficient Linear Fast Attention for Vision Transformers
Chong Wu, Maolin Che, Renjie Xu +2
The attention mechanism is the key to the success of transformers in different machine learning tasks. However, the quadratic complexity with respect to the sequence length of the…