Efficient Multimodal Diffusion Models Using Joint Data Infilling with Partially Shared U-Net

Zizhao Hu, Shaochong Jia, Mohammad Rostami

Recently, diffusion models have been used successfully to fit distributions for cross-modal data translation and multimodal data generation. However, these methods rely on extensiv…