activity
20202026
most citedAdaTask: A Task-aware Adaptive Learning Rate Approach to Multi-task Learning

56 citations · 89 across the 31 of their papers we have counts for

collaborators
Showing 2024 · cs.LGShow all

7 papers · 2 filters

cs.LG2024

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging

Li Shen, Anke Tang, Enneng Yang +6

Multi-task learning (MTL) leverages a shared model to accomplish multiple tasks and facilitate knowledge transfer. Recent research on task arithmetic-based MTL demonstrates that me…

cs.LG2024

SurgeryV2: Bridging the Gap Between Model Merging and Multi-Task Learning with Deep Representation Surgery

Enneng Yang, Li Shen, Zhenyi Wang +5

Model merging-based multitask learning (MTL) offers a promising approach for performing MTL by merging multiple expert models without requiring access to raw training data. However…

cs.LG2024★ 1 cited

Symmetric Graph Contrastive Learning against Noisy Views for Recommendation

Chu Zhao, Enneng Yang, Yuliang Liang +3

Graph Contrastive Learning (GCL) leverages data augmentation techniques to produce contrasting views, enhancing the accuracy of recommendation systems through learning the consiste…

cs.LG2024★ 7 cited

Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities

Enneng Yang, Li Shen, Guibing Guo +4

Model merging is an efficient empowerment technique in the machine learning community that does not require the collection of raw training data and does not require expensive compu…

cs.LG2024

Graph Representation Learning via Causal Diffusion for Out-of-Distribution Recommendation

Chu Zhao, Enneng Yang, Yuliang Liang +5

Graph Neural Networks (GNNs)-based recommendation algorithms typically assume that training and testing data are drawn from independent and identically distributed (IID) spaces. Ho…

cs.LG2024★ 3 cited

FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion

Anke Tang, Li Shen, Yong Luo +5

Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single better-performing model in a cost-effective and…