13 citations · 21 across the 8 of their papers we have counts for
3 papers · 1 filter
LLM Maybe LongLM: Self-Extend LLM Context Window Without Tuning
Hongye Jin, Xiaotian Han, Jingfeng Yang +5
It is well known that LLMs cannot generalize well to long contexts whose lengths are larger than the training sequence length. This poses challenges when employing LLMs for process…
PokeMQA: Programmable knowledge editing for Multi-hop Question Answering
Hengrui Gu, Kaixiong Zhou, Xiaotian Han +3
Multi-hop question answering (MQA) is one of the challenging tasks to evaluate machine's comprehension and reasoning abilities, where large language models (LLMs) have widely achie…
GrowLength: Accelerating LLMs Pretraining by Progressively Growing Training Length
Hongye Jin, Xiaotian Han, Jingfeng Yang +3
The evolving sophistication and intricacies of Large Language Models (LLMs) yield unprecedented advancements, yet they simultaneously demand considerable computational resources an…