5 papers · 1 filter
FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation
Zehao Wang, Guanglei Yang, Yihan Zeng +4
Federated fine-tuning of foundation models with Low-Rank Adaptation (LoRA) provides an efficient solution for reducing communication and computation costs while preserving data loc…
Inversion-DPO: Precise and Efficient Post-Training for Diffusion Models
Zejian Li, Yize Li, Chenye Meng +7
Recent advancements in diffusion models (DMs) have been propelled by alignment methods that post-train models to better conform to human preferences. However, these approaches typi…
LAION-SG: An Enhanced Large-Scale Dataset for Training Complex Image-Text Models with Structural Annotations
Zejian Li, Chenye Meng, Yize Li +9
Recent advances in text-to-image (T2I) generation have shown remarkable success in producing high-quality images from text. However, existing T2I models show decayed performance in…
Distribution Backtracking Builds A Faster Convergence Trajectory for Diffusion Distillation
Shengyuan Zhang, Ling Yang, Zejian Li +6
Accelerating the sampling speed of diffusion models remains a significant challenge. Recent score distillation methods distill a heavy teacher model into a student generator to ach…
Reducing Spatial Fitting Error in Distillation of Denoising Diffusion Models
Shengzhe Zhou, Zejian Lee, Shengyuan Zhang +5
Denoising Diffusion models have exhibited remarkable capabilities in image generation. However, generating high-quality samples requires a large number of iterations. Knowledge dis…