2 papers
cs.LG2025
NoiseAR: AutoRegressing Initial Noise Prior for Diffusion Models
Zeming Li, Xiangyue Liu, Xiangyu Zhang +2
Diffusion models have emerged as powerful generative frameworks, creating data samples by progressively denoising an initial random state. Traditionally, this initial state is samp…
cs.LG2025
Multi-matrix Factorization Attention
Jingcheng Hu, Houyi Li, Yinmin Zhang +5
We propose novel attention architectures, Multi-matrix Factorization Attention (MFA) and MFA-Key-Reuse (MFA-KR). Existing variants for standard Multi-Head Attention (MHA), includin…