2 citations · 2 across the 5 of their papers we have counts for
5 papers
Can Heterogeneous Language Models Be Fused?
Shilian Chen, Jie Zhou, Qin Chen +4
Model merging aims to integrate multiple expert models into a single model that inherits their complementary strengths without incurring the inference-time cost of ensembling. Rece…
Black-box Model Merging for Language-Model-as-a-Service with Massive Model Repositories
Shilian Chen, Jie Zhou, Tianyu Huai +9
Model merging refers to the process of integrating multiple distinct models into a unified model that preserves and combines the strengths and capabilities of the individual models…
LifeAlign: Lifelong Alignment for Large Language Models with Memory-Augmented Focalized Preference Optimization
Junsong Li, Jie Zhou, Bihao Zhan +7
Alignment plays a crucial role in Large Language Models (LLMs) in aligning with human preferences on a specific task/domain. Traditional alignment methods suffer from catastrophic…
Forget What's Sensitive, Remember What Matters: Token-Level Differential Privacy in Memory Sculpting for Continual Learning
Bihao Zhan, Jie Zhou, Junsong Li +9
Continual Learning (CL) models, while adept at sequential knowledge acquisition, face significant and often overlooked privacy challenges due to accumulating diverse information. T…
A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Law
Qianjun Pan, Wenkai Ji, Yuyang Ding +8
This survey explores recent advancements in reasoning large language models (LLMs) designed to mimic "slow thinking" - a reasoning process inspired by human cognition, as described…