Which Long Documents Matter? A Controlled Study of Data Selection for Context Extension

Junlong Jia, Jiang Zhou, Xing Wu +3

Natural long documents are widely used for context extension, but which selection pipelines are effective remains unclear. We conduct a controlled comparison on Qwen2.5-3B at 128K…