4 papers
ACE-LoRA: Adaptive Orthogonal Decoupling for Continual Image Editing
Yuehao Liu, Weijia Zhang, Xuanming Shang +4
State-of-the-art diffusion models often rely on parameter-efficient fine-tuning to perform specialized image editing tasks. However, real-world applications require continual adapt…
Octopus: History-Free Gradient Orthogonalization for Continual Learning in Multimodal Large Language Models
Yuehao Liu, Shanyan Guan, Weijia Zhang +4
Continual learning in multimodal large language models (MLLMs) aims to sequentially acquire knowledge while mitigating catastrophic forgetting, yet existing methods face inherent l…
Guiding a Diffusion Model by Swapping Its Tokens
Weijia Zhang, Yuehao Liu, Shanyan Guan +4
Classifier-Free Guidance (CFG) is a widely used inference-time technique to boost the image quality of diffusion models. Yet, its reliance on text conditions prevents its use in un…
Cross-Architecture Distillation Made Simple with Redundancy Suppression
Weijia Zhang, Yuehao Liu, Wu Ran +1
We describe a simple method for cross-architecture knowledge distillation, where the knowledge transfer is cast into a redundant information suppression formulation. Existing metho…