Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
SELF: Self-Extend the Context Length With Logistic Growth Function
Phat Thanh Dang, Saahil Thoppay, Wang Yang +3
Large language models suffer issues when operated on long contexts that are larger than their training context length due to the standard position encoding for tokens in the attent…
cs.CL2025
100-LongBench: Are de facto Long-Context Benchmarks Literally Evaluating Long-Context Ability?
Wang Yang, Hongye Jin, Shaochen Zhong +4
Long-context capability is considered one of the most important abilities of LLMs, as a truly long context-capable LLM enables users to effortlessly process many originally exhaust…