44 citations · 130 across the 14 of their papers we have counts for
Showing cs.CLShow all
2 papers · 1 filter
cs.CL2024★ 13 cited
LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
Hongye Jin, Xiaotian Han, Jingfeng Yang +5
It is well known that LLMs cannot generalize well to long contexts whose lengths are larger than the training sequence length. This poses challenges when employing LLMs for process…
cs.CL2023★ 4 cited
GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length
Hongye Jin, Xiaotian Han, Jingfeng Yang +3
The evolving sophistication and intricacies of Large Language Models (LLMs) yield unprecedented advancements, yet they simultaneously demand considerable computational resources an…