most citedA Controlled Study on Long Context Extension and Generalization in LLMs

1 citations · 1 across the 3 of their papers we have counts for

collaborators
Showing cs.CLShow all

2 papers · 1 filter

cs.CL2024

State Space Models are Strong Text Rerankers

Zhichao Xu, Jinghua Yan, Ashim Gupta +1

Transformers dominate NLP and IR; but their inference inefficiencies and challenges in extrapolating to longer contexts have sparked interest in alternative model architectures. Am…

cs.CL2024★ 1 cited

A Controlled Study on Long Context Extension and Generalization in LLMs

Yi Lu, Jing Nathan Yan, Songlin Yang +6

Broad textual understanding and in-context learning require language models that utilize full document contexts. Due to the implementation challenges associated with directly train…