Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Kwai Summary Attention V2 Technical Report
OneRec Team, Chenglong Chu, Guohong Mu +30
Summary-token architectures such as Kwai Summary Attention (KSA) compress distant context into learnable Summary token per chunk, and hybrid variants interleave these layers with f…
cs.LG2026
Towards Easier-to-Tune Training Algorithms: New Results from AlgoPerf
Priya Kasimbeg, Ahmed Khaled, Aahlad Chandrabhatta +9
Evaluating deep learning optimizer is challenging because confounding factors such as hyperparameter tuning and optimizer-model co-design often obscure true algorithmic performance…