3 papers
cs.LG2026
A Unified Framework for Knowledge Transfer in Bidirectional Model Scaling
Jianlu Shen, Fu Feng, Jiaze Xu +3
Transferring pre-trained knowledge from a source model to a target model of a different architectural size is a key challenge for flexible and efficient model scaling. However, cur…
cs.LG2025
Knowledge Diversion for Efficient Morphology Control and Policy Transfer
Fu Feng, Ruixiao Shi, Yucheng Xie +3
Universal morphology control aims to learn a universal policy that generalizes across heterogeneous agent morphologies, with Transformer-based controllers emerging as a popular cho…
cs.CV2024
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models
Yucheng Xie, Fu Feng, Ruixiao Shi +4
The training of diffusion models is computationally intensive, making effective pre-training essential. However, real-world deployments often demand models of variable sizes due to…