3 citations · 3 across the 5 of their papers we have counts for
5 papers
A Unified Framework for Knowledge Transfer in Bidirectional Model Scaling
Jianlu Shen, Fu Feng, Jiaze Xu +3
Transferring pre-trained knowledge from a source model to a target model of a different architectural size is a key challenge for flexible and efficient model scaling. However, cur…
Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform
Jianlu Shen, Fu Feng, Yucheng Xie +2
Transferring knowledge by fine-tuning large-scale pre-trained networks has become a standard paradigm for downstream tasks, yet the knowledge of a pre-trained model is tightly coup…
Knowledge Diversion for Efficient Morphology Control and Policy Transfer
Fu Feng, Ruixiao Shi, Yucheng Xie +3
Universal morphology control aims to learn a universal policy that generalizes across heterogeneous agent morphologies, with Transformer-based controllers emerging as a popular cho…
FINE: Factorizing Knowledge for Initialization of Variable-sized Diffusion Models
Yucheng Xie, Fu Feng, Ruixiao Shi +4
The training of diffusion models is computationally intensive, making effective pre-training essential. However, real-world deployments often demand models of variable sizes due to…
Effective Audio Classification Network Based on Paired Inverse Pyramid Structure and Dense MLP Block
Yunhao Chen, Yunjie Zhu, Zihui Yan +4
Recently, massive architectures based on Convolutional Neural Network (CNN) and self-attention mechanisms have become necessary for audio classification. While these techniques are…