4 papers · 2 filters
E-MMDiT: Revisiting Multimodal Diffusion Transformer Design for Fast Image Synthesis under Limited Resources
Tong Shen, Jingai Yu, Dong Zhou +2
Diffusion models have shown strong capabilities in generating high-quality images from text prompts. However, these models often require large-scale training data and significant c…
Layout-Conditioned Autoregressive Text-to-Image Generation via Structured Masking
Zirui Zheng, Takashi Isobe, Tong Shen +12
Although autoregressive (AR) models have demonstrated remarkable success in image generation, extending these models to layout-conditioned generation remains challenging due to the…
AMD-Hummingbird: Towards an Efficient Text-to-Video Model
Takashi Isobe, He Cui, Dong Zhou +3
Text-to-Video (T2V) generation has attracted significant attention for its ability to synthesize realistic videos from textual descriptions. However, existing models struggle to ba…
Edit as You See: Image-guided Video Editing via Masked Motion Modeling
Zhi-Lin Huang, Yixuan Liu, Chujun Qin +4
Recent advancements in diffusion models have significantly facilitated text-guided video editing. However, there is a relative scarcity of research on image-guided video editing, a…