Showing 2026Show all
2 papers · 1 filter
cs.CL2026
T^2MLR: Transformer with Temporal Middle-Layer Recurrence
Ziyang Cai, Xingyu Zhu, Yihe Dong +2
Transformer reasoning is limited by autoregressive decoding, which repeat edly compresses rich hidden computation through token space and makes it difficult for intermediate reason…
cs.LG2026
Muon: Muon with Fractional Spectral Powers
Yihe Dong, Will Sawin
Muon is an increasingly widely used optimizer that replaces a gradient with its polar factor , thereby flattening the singular spectrum. However, full flatten…