72 citations · 109 across the 11 of their papers we have counts for
1 paper · 1 filter
Patrick Huber, Ernie Chang, Chinnadhurai Sankar +4
Extending the context window of language models typically requires expensive long-context pre-training, posing significant challenges for both training efficiency and data collecti…