4 papers
Over++: Generative Video Compositing for Layer Interaction Effects
Luchao Qi, Jiaye Wu, Jun Myeong Choi +3
In professional video compositing workflows, artists must manually create environmental interactions-such as shadows, reflections, dust, and splashes-between foreground subjects an…
Generative AI for 2D Character Animation
Jaime Guajardo, Ozgun Bursalioglu, Dan B Goldman
In this pilot project, we teamed up with artists to develop new workflows for 2D animation while producing a short educational cartoon. We identified several workflows to streamlin…
Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusion
Kira Prabhu, Jane Wu, Lynn Tsai +4
This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation…
Readout Guidance: Learning Control from Diffusion Features
Grace Luo, Trevor Darrell, Oliver Wang +2
We present Readout Guidance, a method for controlling text-to-image diffusion models with learned signals. Readout Guidance uses readout heads, lightweight networks trained to extr…