3 papers
cs.CL2026
Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
Xialie Zhuang, Zhikai Jia, Jianjin Li +4
Large Language Models (LLMs) are discovered to suffer from accurately retrieving key information. To address this, we propose Mask-Enhanced Autoregressive Prediction (MEAP), a simp…
cs.AI2025
Effective Learning for Small Reasoning Models: An Empirical Study on 0.5B Reasoning LLMs
Xialie Zhuang, Peixian Ma, Zhikai Jia +2
The ongoing evolution of language models has led to the development of large-scale architectures that demonstrate exceptional performance across a wide range of tasks. However, the…
cs.CL2025
Exploring Information Processing in Large Language Models: Insights from Information Bottleneck Theory
Zhou Yang, Zhengyu Qi, Zhaochun Ren +4
Large Language Models (LLMs) have demonstrated remarkable performance across a wide range of tasks by understanding input information and predicting corresponding outputs. However,…