3 papers
cs.CL2025
Sliding Window Attention Training for Efficient Large Language Models
Zichuan Fu, Wentao Song, Yejing Wang +7
Recent advances in transformer-based Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks. However, their quadratic computational complexity…
cs.IR2025
GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systems
Sheng Zhang, Maolin Wang, Wanyu Wang +6
Transformer-based models have gained significant traction in sequential recommender systems (SRSs) for their ability to capture user-item interactions effectively. However, these m…
cs.CL2025
Streamlining the Collaborative Chain of Models into A Single Forward Pass in Generation-Based Tasks
Yuanjie Lyu, Chao Zhang, Yuhao Chen +2
In Retrieval-Augmented Generation (RAG) and agent-based frameworks, the "Chain of Models" approach is widely used, where multiple specialized models work sequentially on distinct s…