activity
20232025
most citedDeep Model Fusion: A Survey

14 citations · 25 across the 13 of their papers we have counts for

collaborators
Showing cs.LGShow all

10 papers · 1 filter

cs.LG2025

Refining Few-Step Text-to-Multiview Diffusion via Reinforcement Learning

Ziyi Zhang, Li Shen, Deheng Ye +5

Text-to-multiview (T2MV) diffusion models have shown great promise in generating multiple views of a scene from a single text prompt. While few-step backbones enable real-time T2MV…

cs.LG20241 cited

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models

Anke Tang, Li Shen, Yong Luo +5

Deep model training on extensive datasets is increasingly becoming cost-prohibitive, prompting the widespread adoption of deep model fusion techniques to leverage knowledge from pr…

cs.LG2024

Towards Efficient Pareto Set Approximation via Mixture of Experts Based Model Fusion

Anke Tang, Li Shen, Yong Luo +4

Solving multi-objective optimization problems for large deep neural networks is a challenging task due to the complexity of the loss landscape and the expensive computational cost…

cs.LG2024

FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion

Anke Tang, Li Shen, Yong Luo +5

Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single better-performing model in a cost-effective and…

cs.LG2024

Federated Learning with Only Positive Labels by Exploring Label Correlations

Xuming An, Dui Wang, Li Shen +5

Federated learning aims to collaboratively learn a model by using the data from multiple users under privacy constraints. In this paper, we study the multi-label classification pro…

cs.LG2024

Merging Multi-Task Models via Weight-Ensembling Mixture of Experts

Anke Tang, Li Shen, Yong Luo +3

Merging various task-specific Transformer-based models trained on different tasks into a single unified model can execute all the tasks concurrently. Previous methods, exemplified…