5 papers
Breaking the Scale Barrier: One-Shot Knowledge Transfer via Frequency Transform
Jianlu Shen, Fu Feng, Yucheng Xie +2
Transferring knowledge by fine-tuning large-scale pre-trained networks has become a standard paradigm for downstream tasks, yet the knowledge of a pre-trained model is tightly coup…
A Unified Framework for Knowledge Transfer in Bidirectional Model Scaling
Jianlu Shen, Fu Feng, Jiaze Xu +3
Transferring pre-trained knowledge from a source model to a target model of a different architectural size is a key challenge for flexible and efficient model scaling. However, cur…
Mask Consistency Regularization in Object Removal
Hua Yuan, Jin Yuan, Yicheng Jiang +3
Object removal, a challenging task within image inpainting, involves seamlessly filling the removed region with content that matches the surrounding context. Despite advancements i…
DivControl: Knowledge Diversion for Controllable Image Generation
Yucheng Xie, Fu Feng, Ruixiao Shi +3
Diffusion models have advanced from text-to-image (T2I) to image-to-image (I2I) generation by incorporating structured inputs such as depth maps, enabling fine-grained spatial cont…
KIND: Knowledge Integration and Diversion for Training Decomposable Models
Yucheng Xie, Fu Feng, Ruixiao Shi +3
Pre-trained models have become the preferred backbone due to the increasing complexity of model parameters. However, traditional pre-trained models often face deployment challenges…