2 papers
cs.CL2025
Long-context Language Models Fail in Basic Retrieval Tasks Without Sufficient Reasoning Steps
Yijiong Yu, Yongfeng Huang, Zhixiao Qi +4
Long-context language models (LCLMs), characterized by their extensive context window, are becoming popular. However, despite the fact that they are nearly perfect at standard long…
cs.CL2024
Training With "Paraphrasing the Original Text" Teaches LLM to Better Retrieve in Long-context Tasks
Yijiong Yu, Yongfeng Huang, Zhixiao Qi +1
As Large Language Models (LLMs) continue to evolve, more are being designed to handle long-context inputs. Despite this advancement, most of them still face challenges in accuratel…