Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
ILRe: Intermediate Layer Retrieval for Context Compression in Causal Language Models
Manlai Liang, Mandi Liu, Jiangzhou Ji +4
Large Language Models (LLMs) have demonstrated success across many benchmarks. However, they still exhibit limitations in long-context scenarios, primarily due to their short effec…
cs.CL2025
Lag-Relative Sparse Attention In Long Context Training
Manlai Liang, Wanyi Huang, Mandi Liu +2
Large Language Models (LLMs) have made significant strides in natural language processing and generation, yet their ability to handle long-context input remains constrained by the…