21 citations · 61 across the 18 of their papers we have counts for
12 papers · 1 filter
SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model
Shaoan Xie, Zhifei Zhang, Zhe Lin +2
Generic image inpainting aims to complete a corrupted image by borrowing surrounding information, which barely generates novel content. By contrast, multi-modal inpainting provides…
ObjectStitch: Generative Object Compositing
Yizhi Song, Zhifei Zhang, Zhe Lin +5
Object compositing based on 2D images is a challenging problem since it typically involves multiple processing stages such as color harmonization, geometry correction and shadow ge…
Structure-Guided Image Completion with Image-level and Object-level Semantic Discriminators
Haitian Zheng, Zhe Lin, Jingwan Lu +8
Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications fo…
3D-FM GAN: Towards 3D-Controllable Face Manipulation
Yuchen Liu, Zhixin Shu, Yijun Li +3
3D-controllable portrait synthesis has significantly advanced, thanks to breakthroughs in generative adversarial networks (GANs). However, it is still challenging to manipulate exi…
Text-to-Image Generation via Implicit Visual Guidance and Hypernetwork
Xin Yuan, Zhe Lin, Jason Kuen +2
We develop an approach for text-to-image generation that embraces additional retrieval images, driven by a combination of implicit visual guidance loss and generative objectives. U…
HyperNST: Hyper-Networks for Neural Style Transfer
Dan Ruta, Andrew Gilbert, Saeid Motiian +3
We present HyperNST; a neural style transfer (NST) technique for the artistic stylization of images, based on Hyper-networks and the StyleGAN2 architecture. Our contribution is a n…
Controllable Shadow Generation Using Pixel Height Maps
Yichen Sheng, Yifan Liu, Jianming Zhang +6
Shadows are essential for realistic image compositing. Physics-based shadow rendering methods require 3D geometries, which are not always available. Deep learning-based shadow synt…
Layered Depth Refinement with Mask Guidance
Soo Ye Kim, Jianming Zhang, Simon Niklaus +4
Depth maps are used in a wide range of applications from 3D rendering to 2D image effects such as Bokeh. However, those predicted by single image depth estimation (SIDE) models oft…
GALA: Toward Geometry-and-Lighting-Aware Object Search for Compositing
Sijie Zhu, Zhe Lin, Scott Cohen +3
Compositing-aware object search aims to find the most compatible objects for compositing given a background image and a query bounding box. Previous works focus on learning compati…
Interactive Portrait Harmonization
Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang +7
Current image harmonization methods consider the entire background as the guidance for harmonization. However, this may limit the capability for user to choose any specific object/…
CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training
Haitian Zheng, Zhe Lin, Jingwan Lu +7
Recent image inpainting methods have made great progress but often struggle to generate plausible image structures when dealing with large holes in complex images. This is partiall…
CoGS: Controllable Generation and Search from Sketch and Style
Cusuh Ham, Gemma Canet Tarres, Tu Bui +3
We present CoGS, a novel method for the style-conditioned, sketch-driven synthesis of images. CoGS enables exploration of diverse appearance possibilities for a given sketched obje…