7 papers
Appearance Pointers -- Multimodal Region Control of Diffusion Transformers
Rahul Sajnani, Yulia Gryaditskaya, Radomír Měch +2
Controllable image generation remains challenging for creative professionals, who often require precise regional control over materials, object identities, and spatial arrangements…
EM-Vid: Training-Free Entity-Centric Memory for Efficient and Consistent Multi-Shot Video Generation
Jente Vandersanden, Matheus Gadelha, Chun-Hao P. Huang +2
Multi-shot video generation requires maintaining a consistent appearance of recurring entities across shots while remaining faithful to shot-specific text prompts. Recent autoregre…
TrajectoryMover: Generative Movement of Object Trajectories in Videos
Kiran Chhatre, Hyeonho Jeong, Yulia Gryaditskaya +3
Generative video editing has enabled creative control over an object's position in a video by prescribing an object's 3D or 2D motion trajectory, while preserving both video plausi…
SketchingReality: From Freehand Scene Sketches To Photorealistic Images
Ahmed Bourouis, Mikhail Bessmeltsev, Yulia Gryaditskaya
Recent years have witnessed remarkable progress in generative AI, with natural language emerging as the most common conditioning input. As underlying models grow more powerful, res…
SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Time
Zhening Huang, Hyeonho Jeong, Xuelin Chen +4
We present SpaceTimePilot, a video diffusion model that disentangles space and time for controllable generative rendering. Given a monocular video, SpaceTimePilot can independently…
GroundUp: Rapid Sketch-Based 3D City Massing
Gizem Esra Unlu, Mohamed Sayed, Yulia Gryaditskaya +1
We propose GroundUp, the first sketch-based ideation tool for 3D city massing of urban areas. We focus on early-stage urban design, where sketching is a common tool and the design…
Open Vocabulary Semantic Scene Sketch Understanding
Ahmed Bourouis, Judith Ellen Fan, Yulia Gryaditskaya
We study the underexplored but fundamental vision problem of machine understanding of abstract freehand scene sketches. We introduce a sketch encoder that results in semantically-a…