Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Kaczmarz Linear Attention
Jiaxuan Zou, Ruifeng Ren, Yong Liu
Long-context language modeling remains central to modern sequence modeling, but the quadratic cost of Transformer attention makes scaling computationally prohibitive. Linear recurr…
cs.LG2025
The Procrustean Bed of Time Series: The Optimization Bias in Point-wise Loss Functions
Rongyao Cai, Yuxi Wan, Kexin Zhang +6
Intuitively, a more deterministic time series should be easier to forecast. However, point-wise loss functions (e.g., MSE and MAE), serving as differentiable surrogates for the ide…