most citedA Controlled Study on Long Context Extension and Generalization in LLMs

1 citations · 1 across the 1 of their papers we have counts for

collaborators
Showing cs.CLShow all

2 papers · 1 filter

cs.CL2024★ 1 cited

A Controlled Study on Long Context Extension and Generalization in LLMs

Yi Lu, Jing Nathan Yan, Songlin Yang +6

Broad textual understanding and in-context learning require language models that utilize full document contexts. Due to the implementation challenges associated with directly train…

cs.CL2024

Simple and Effective Masked Diffusion Language Models

Subham Sekhar Sahoo, Marianne Arriola, Yair Schiff +5

While diffusion models excel at generating high-quality images, prior work reports a significant performance gap between diffusion and autoregressive (AR) methods in language model…