6 citations · 7 across the 5 of their papers we have counts for
5 papers
Fourier-Mixed Window Attention: Accelerating Informer for Long Sequence Time-Series Forecasting
Nhat Thanh Tran, Jack Xin
We study a fast local-global window-based attention method to accelerate Informer for long sequence time-series forecasting. While window attention being local is a considerable co…
Proximal Implicit ODE Solvers for Accelerating Learning Neural ODEs
Justin Baker, Hedi Xia, Yiwei Wang +7
Learning neural ODEs often requires solving very stiff ODE systems, primarily using explicit adaptive step size ODE solvers. These solvers are computationally expensive, requiring…
Enhancing Zero-Shot Many to Many Voice Conversion with Self-Attention VAE
Ziang Long, Yunling Zheng, Meng Yu +1
Variational auto-encoder (VAE) is an effective neural network architecture to disentangle a speech utterance into speaker identity and linguistic content latent embeddings, then ge…
glassoformer: a query-sparse transformer for post-fault power grid voltage prediction
Yunling Zheng, Carson Hu, Guang Lin +3
We propose GLassoformer, a novel and efficient transformer architecture leveraging group Lasso regularization to reduce the number of queries of the standard self-attention mechani…
An Integrated Approach to Produce Robust Models with High Efficiency
Zhijian Li, Bao Wang, Jack Xin
Deep Neural Networks (DNNs) needs to be both efficient and robust for practical uses. Quantization and structure simplification are promising ways to adapt DNNs to mobile devices,…