2 papers
cs.CL2025
MuDAF: Long-Context Multi-Document Attention Focusing through Contrastive Learning on Attention Heads
Weihao Liu, Ning Wu, Shiping Yang +4
Large Language Models (LLMs) frequently show distracted attention due to irrelevant information in the input, which severely impairs their long-context capabilities. Inspired by re…
cs.LG2024
ControlMath: Controllable Data Generation Promotes Math Generalist Models
Nuo Chen, Ning Wu, Jianhui Chang +1
Utilizing large language models (LLMs) for data augmentation has yielded encouraging results in mathematical reasoning. However, these approaches face constraints in problem divers…