3 papers
cs.CL2025
RoSA: Enhancing Parameter-Efficient Fine-Tuning via RoPE-aware Selective Adaptation in Large Language Models
Dayan Pan, Jingyuan Wang, Yilong Zhou +3
Fine-tuning large language models is essential for task-specific adaptation, yet it remains computationally prohibitive. Parameter-Efficient Fine-Tuning (PEFT) methods have emerged…
cs.AI2025
Contextual Attention Modulation: Towards Efficient Multi-Task Adaptation in Large Language Models
Dayan Pan, Zhaoyang Fu, Jingyuan Wang +3
Large Language Models (LLMs) possess remarkable generalization capabilities but struggle with multi-task adaptation, particularly in balancing knowledge retention with task-specifi…
cs.LG2025
A Dataset for Spatiotemporal-Sensitive POI Question Answering
Xiao Han, Dayan Pan, Xiangyu Zhao +4
Spatiotemporal relationships are critical in data science, as many prediction and reasoning tasks require analysis across both spatial and temporal dimensions--for instance, naviga…