12 citations · 18 across the 11 of their papers we have counts for
4 papers · 1 filter
Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
Hao Ban, Kaiyi Ji
Large language models are often adapted using parameter-efficient techniques such as Low-Rank Adaptation (LoRA), formulated as , where is the pre-trained para…
SAMO: A Lightweight Sharpness-Aware Approach for Multi-Task Optimization with Joint Global-Local Perturbation
Hao Ban, Gokul Ram Subramani, Kaiyi Ji
Multi-task learning (MTL) enables a joint model to capture commonalities across multiple tasks, reducing computation costs and improving data efficiency. However, a major challenge…
LDC-MTL: Balancing Multi-Task Learning through Scalable Loss Discrepancy Control
Peiyao Xiao, Chaosheng Dong, Shaofeng Zou +1
Multi-task learning (MTL) has been widely adopted for its ability to simultaneously learn multiple tasks. While existing gradient manipulation methods often yield more balanced sol…
ReciNet: Reciprocal Space-Aware Long-Range Modeling for Crystalline Property Prediction
Jianan Nie, Peiyao Xiao, Kaiyi Ji +1
Predicting properties of crystals from their structures is a fundamental yet challenging task in materials science. Unlike molecules, crystal structures exhibit infinite periodic a…