1 citations · 1 across the 7 of their papers we have counts for
4 papers · 1 filter
PACT: Preserving Anchored Cores in Task-vectors for Model Merging
Ningyuan Shi, Zhipeng Zhou, Hao Wang +2
Model merging has emerged as a training-free alternative to multi-task learning, aiming to combine multiple task-specific fine-tuned models into a single multi-task model. Most exi…
ProteinOPD: Towards Effective and Efficient Preference Alignment for Protein Design
Yulin Zhang, He Cao, Zihao Jiang +6
Designing proteins with desired functions or properties represents a core goal in synthetic biology and drug discovery. Recent advances in protein language models (PLMs) have enabl…
Injecting Imbalance Sensitivity for Multi-Task Learning
Zhipeng Zhou, Liu Liu, Peilin Zhao +1
Multi-task learning (MTL) has emerged as a promising approach for deploying deep learning models in real-life applications. Recent studies have proposed optimization-based learning…
Continual Optimization with Symmetry Teleportation for Multi-Task Learning
Zhipeng Zhou, Ziqiao Meng, Pengcheng Wu +2
Multi-task learning (MTL) is a widely explored paradigm that enables the simultaneous learning of multiple tasks using a single model. Despite numerous solutions, the key issues of…