Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
Attention Basin: Why Contextual Position Matters in Large Language Models
Zihao Yi, Delong Zeng, Zhenqing Ling +6
The performance of Large Language Models (LLMs) is significantly sensitive to the contextual position of information in the input. To investigate the mechanism behind this position…
cs.CL2025
Diversity as a Reward: Fine-Tuning LLMs on a Mixture of Domain-Undetermined Data
Zhenqing Ling, Daoyuan Chen, Liuyi Yao +3
Fine-tuning large language models (LLMs) using diverse datasets is crucial for enhancing their overall performance across various domains. In practical scenarios, existing methods…