22 citations · 69 across the 17 of their papers we have counts for
17 papers
Diffusion-Augmented Depth Prediction with Sparse Annotations
Jiaqi Li, Yiran Wang, Zihao Huang +4
Depth estimation aims to predict dense depth maps. In autonomous driving scenes, sparsity of annotations makes the task challenging. Supervised models produce concave objects due t…
NVDS+: Towards Efficient and Versatile Neural Stabilizer for Video Depth Estimation
Yiran Wang, Min Shi, Jiaqi Li +7
Video depth estimation aims to infer temporally consistent depth. One approach is to finetune a single-image model on each video with geometry constraints, which proves inefficient…
Photoswap: Personalized Subject Swapping in Images
Jing Gu, Yilin Wang, Nanxuan Zhao +8
In an era where images and visual content dominate our digital landscape, the ability to manipulate and personalize these images has become a necessity. Envision seamlessly substit…
3D Cinemagraphy from a Single Image
Xingyi Li, Zhiguo Cao, Huiqiang Sun +3
We present 3D Cinemagraphy, a new technique that marries 2D image animation with 3D photography. Given a single still image as input, our goal is to generate a video that contains…
PixHt-Lab: Pixel Height Based Light Effect Generation for Image Compositing
Yichen Sheng, Jianming Zhang, Julien Philip +5
Lighting effects such as shadows or reflections are key in making synthetic images realistic and visually appealing. To generate such effects, traditional computer graphics uses a…
ObjectStitch: Generative Object Compositing
Yizhi Song, Zhifei Zhang, Zhe Lin +5
Object compositing based on 2D images is a challenging problem since it typically involves multiple processing stages such as color harmonization, geometry correction and shadow ge…
Structure-Guided Image Completion with Image-level and Object-level Semantic Discriminators
Haitian Zheng, Zhe Lin, Jingwan Lu +8
Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications fo…
Perspective Fields for Single Image Camera Calibration
Linyi Jin, Jianming Zhang, Yannick Hold-Geoffroy +4
Geometric camera calibration is often required for applications that understand the perspective of the image. We propose perspective fields as a representation that models the loca…
SceneComposer: Any-Level Semantic Image Synthesis
Yu Zeng, Zhe Lin, Jianming Zhang +4
We propose a new framework for conditional image synthesis from semantic layouts of any precision levels, ranging from pure text to a 2D semantic canvas with precise shapes. More s…
Towards Accurate Reconstruction of 3D Scene Shape from A Single Monocular Image
Wei Yin, Jianming Zhang, Oliver Wang +4
Despite significant progress made in the past few years, challenges remain for depth estimation using a single monocular image. First, it is nontrivial to train a metric-depth pred…
Less is More: Consistent Video Depth Estimation with Masked Frames Modeling
Yiran Wang, Zhiyu Pan, Xingyi Li +3
Temporal consistency is the key challenge of video depth estimation. Previous works are based on additional optical flow or camera poses, which is time-consuming. By contrast, we d…
MPIB: An MPI-Based Bokeh Rendering Framework for Realistic Partial Occlusion Effects
Juewen Peng, Jianming Zhang, Xianrui Luo +3
Partial occlusion effects are a phenomenon that blurry objects near a camera are semi-transparent, resulting in partial appearance of occluded background. However, it is challengin…
Controllable Shadow Generation Using Pixel Height Maps
Yichen Sheng, Yifan Liu, Jianming Zhang +6
Shadows are essential for realistic image compositing. Physics-based shadow rendering methods require 3D geometries, which are not always available. Deep learning-based shadow synt…
Towards Domain-agnostic Depth Completion
Guangkai Xu, Wei Yin, Jianming Zhang +4
Existing depth completion methods are often targeted at a specific sparse depth type and generalize poorly across task domains. We present a method to complete sparse/semi-dense, n…
BokehMe: When Neural Rendering Meets Classical Rendering
Juewen Peng, Zhiguo Cao, Xianrui Luo +3
We propose BokehMe, a hybrid bokeh rendering framework that marries a neural renderer with a classical physically motivated renderer. Given a single image and a potentially imperfe…
Layered Depth Refinement with Mask Guidance
Soo Ye Kim, Jianming Zhang, Simon Niklaus +4
Depth maps are used in a wide range of applications from 3D rendering to 2D image effects such as Bokeh. However, those predicted by single image depth estimation (SIDE) models oft…
Interactive Portrait Harmonization
Jeya Maria Jose Valanarasu, He Zhang, Jianming Zhang +7
Current image harmonization methods consider the entire background as the guidance for harmonization. However, this may limit the capability for user to choose any specific object/…