3 papers
cs.CL2026
Quantifying and Improving the Robustness of Retrieval-Augmented Language Models Against Spurious Features in Grounding Data
Shiping Yang, Jie Wu, Wenbiao Ding +7
Robustness has become a critical attribute for the deployment of RAG systems in real-world applications. Existing research focuses on robustness to explicit noise (e.g., document s…
cs.CL2025
MuDAF: Long-Context Multi-Document Attention Focusing through Contrastive Learning on Attention Heads
Weihao Liu, Ning Wu, Shiping Yang +4
Large Language Models (LLMs) frequently show distracted attention due to irrelevant information in the input, which severely impairs their long-context capabilities. Inspired by re…
cs.CL2024
Fostering Natural Conversation in Large Language Models with NICO: a Natural Interactive COnversation dataset
Renliang Sun, Mengyuan Liu, Shiping Yang +3
Benefiting from diverse instruction datasets, contemporary Large Language Models (LLMs) perform effectively as AI assistants in collaborating with humans. However, LLMs still strug…