1 citations · 2 across the 9 of their papers we have counts for
4 papers · 1 filter
Transformers and Their Roles as Time Series Foundation Models
Dennis Wu, Yihan He, Yuan Cao +2
We give a comprehensive analysis of transformers as time series foundation models, focusing on their approximation and generalization capabilities. First, we demonstrate that there…
Uniform Memory Retrieval with Larger Capacity for Modern Hopfield Models
Dennis Wu, Jerry Yao-Chieh Hu, Teng-Yun Hsiao +1
We propose a two-stage memory retrieval dynamics for modern Hopfield models, termed , with enhanced memory capacity. Our key contribution is a learnable feat…
STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction
Dennis Wu, Jerry Yao-Chieh Hu, Weijian Li +2
We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a novel…
On Sparse Modern Hopfield Model
Jerry Yao-Chieh Hu, Donglin Yang, Dennis Wu +3
We introduce the sparse modern Hopfield model as a sparse extension of the modern Hopfield model. Like its dense counterpart, the sparse modern Hopfield model equips a memory-retri…