2 citations · 2 across the 3 of their papers we have counts for
3 papers
cs.LG2026
LT2: Linear-Time Looped Transformers
Chunyuan Deng, Yizhe Zhang, Rui-Jie Zhu +4
Looped Transformers (LT) have emerged as a powerful architecture by iterating their layers multiple times before decoding the final token. However, pairing them with full attention…
cs.CL2025★ 2 cited
A Comprehensive Survey on Long Context Language Modeling
Jiaheng Liu, Dawei Zhu, Zhiqi Bai +34
Efficient processing of long contexts has been a persistent pursuit in Natural Language Processing. With the growing number of long documents, dialogues, and other textual data, it…
cs.CL2025
Reformulation for Pretraining Data Augmentation
Xintong Hao, Ruijie Zhu, Ge Zhang +2
Despite the impressive capabilities of large language models across various tasks, their continued scaling is severely hampered not only by data scarcity but also by the performanc…