4 papers
Rethinking Token Prediction: Tree-Structured Diffusion Language Model
Zihao Wu, Haoming Yang, Juncheng Dong +1
Discrete diffusion language models have emerged as a competitive alternative to auto-regressive language models, but training them efficiently under limited parameter and memory bu…
Elliptic Loss Regularization
Ali Hasan, Haoming Yang, Yuting Ng +1
Regularizing neural networks is important for anticipating model behavior in regions of the data space that are not well represented. In this work, we propose a regularization tech…
Parabolic Continual Learning
Haoming Yang, Ali Hasan, Vahid Tarokh
Regularizing continual learning techniques is important for anticipating algorithmic behavior under new realizations of data. We introduce a new approach to continual learning by i…
S2TX: Cross-Attention Multi-Scale State-Space Transformer for Time Series Forecasting
Zihao Wu, Juncheng Dong, Haoming Yang +1
Time series forecasting has recently achieved significant progress with multi-scale models to address the heterogeneity between long and short range patterns. Despite their state-o…