Showing 2026Show all
2 papers · 1 filter
cs.LG2026
Trading Depth for Time in Recurrent Transformers
Zeyi Huang, Xuehai He, Yong Jae Lee +1
Recurrent Transformers increase computational depth through temporal recurrence, feeding each token's high-level hidden state into the computation of the next. This raises a natura…
cs.LG2026
Latent Recurrent Transformer: Architecture Exploration, Training Strategies, and Scaling Behavior
Zeyi Huang, Xuehai He, LiLiang Ren +8
We study Latent Recurrent Transformer (LRT), a lightweight augmentation of autoregressive transformers that reuses a high-level source-layer hidden state from the previous token as…