4 papers · 1 filter
Forget What's Sensitive, Remember What Matters: Token-Level Differential Privacy in Memory Sculpting for Continual Learning
Bihao Zhan, Jie Zhou, Junsong Li +9
Continual Learning (CL) models, while adept at sequential knowledge acquisition, face significant and often overlooked privacy challenges due to accumulating diverse information. T…
Can Heterogeneous Language Models Be Fused?
Shilian Chen, Jie Zhou, Qin Chen +4
Model merging aims to integrate multiple expert models into a single model that inherits their complementary strengths without incurring the inference-time cost of ensembling. Rece…
Black-box Model Merging for Language-Model-as-a-Service with Massive Model Repositories
Shilian Chen, Jie Zhou, Tianyu Huai +9
Model merging refers to the process of integrating multiple distinct models into a unified model that preserves and combines the strengths and capabilities of the individual models…
A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Law
Qianjun Pan, Wenkai Ji, Yuyang Ding +8
This survey explores recent advancements in reasoning large language models (LLMs) designed to mimic "slow thinking" - a reasoning process inspired by human cognition, as described…