287 citations · 530 across the 39 of their papers we have counts for
40 papers
StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation
Yinxi He, Kang Liao, Chunyu Lin +2
This paper introduces StructDiff, a generative framework based on a single-scale diffusion model for single-image generation. Single-image generation aims to synthesize diverse sam…
UniStitch: Unifying Semantic and Geometric Features for Image Stitching
Yuan Mei, Lang Nie, Kang Liao +3
Traditional image stitching methods estimate warps from hand-crafted geometric features, whereas recent learning-based solutions leverage semantic features from neural networks ins…
Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editing
Jiyuan Wang, Chunyu Lin, Lei Sun +8
Leveraging the priors of 2D diffusion models for 3D editing has emerged as a promising paradigm. However, multi-view consistency remains challenging in edited results, and the extr…
From Editor to Dense Geometry Estimator
JiYuan Wang, Chunyu Lin, Lei Sun +5
Leveraging visual priors from pre-trained text-to-image (T2I) generative models has shown success in dense prediction. However, dense prediction is inherently an image-to-image tas…
Robust Image Stitching with Optimal Plane
Lang Nie, Yuan Mei, Kang Liao +3
We present \textit{RopStitch}, an unsupervised deep image stitching framework with both robustness and naturalness. To ensure the robustness of \textit{RopStitch}, we propose to in…
StabStitch++: Unsupervised Online Video Stitching with Spatiotemporal Bidirectional Warps
Lang Nie, Chunyu Lin, Kang Liao +3
We retarget video stitching to an emerging issue, named warping shake, which unveils the temporal content shakes induced by sequentially unsmooth warps when extending image stitchi…
You Need a Transition Plane: Bridging Continuous Panoramic 3D Reconstruction with Perspective Gaussian Splatting
Zhijie Shen, Chunyu Lin, Shujuan Huang +3
Recently, reconstructing scenes from a single panoramic image using advanced 3D Gaussian Splatting (3DGS) techniques has attracted growing interest. Panoramic images offer a 360$\t…
Beyond Wide-Angle Images: Structure-to-Detail Video Portrait Correction via Unsupervised Spatiotemporal Adaptation
Wenbo Nie, Lang Nie, Chunyu Lin +4
Wide-angle cameras, despite their popularity for content creation, suffer from distortion-induced facial stretching-especially at the edge of the lens-which degrades visual appeal.…
Semi-Supervised 360 Layout Estimation with Panoramic Collaborative Perturbations
Junsong Zhang, Chunyu Lin, Zhijie Shen +3
The performance of existing supervised layout estimation methods heavily relies on the quality of data annotations. However, obtaining large-scale and high-quality datasets remains…
Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation
Jiyuan Wang, Chunyu Lin, Cheng Guan +5
In this paper, we propose Jasmine, the first Stable Diffusion (SD)-based self-supervised framework for monocular depth estimation, which effectively harnesses SD's visual priors to…
Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspective
Zhijie Shen, Chunyu Lin, Lang Nie +3
Depth estimation from a monocular 360 image is important to the perception of the entire 3D environment. However, the inherent distortion and large field of view (FoV) in 360 image…
SGFormer: Spherical Geometry Transformer for 360 Depth Estimation
Junsong Zhang, Zisong Chen, Chunyu Lin +5
Panoramic distortion poses a significant challenge in 360 depth estimation, particularly pronounced at the north and south poles. Existing methods either adopt a bi-projection fusi…
Digging into contrastive learning for robust depth estimation with diffusion models
Jiyuan Wang, Chunyu Lin, Lang Nie +3
Recently, diffusion-based depth estimation methods have drawn widespread attention due to their elegant denoising patterns and promising performance. However, they are typically un…
Eliminating Warping Shakes for Unsupervised Online Video Stitching
Lang Nie, Chunyu Lin, Kang Liao +4
In this paper, we retarget video stitching to an emerging issue, named warping shake, when extending image stitching to video stitching. It unveils the temporal instability of warp…
Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond
Lang Nie, Chunyu Lin, Kang Liao +2
Thin-plate spline (TPS) is a principal warp that allows for representing elastic, nonlinear transformation with control point motions. With the increase of control points, the warp…
360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception
Zhijie Shen, Chunyu Lin, Junsong Zhang +3
Existing panoramic layout estimation solutions tend to recover room boundaries from a vertically compressed sequence, yielding imprecise results as the compression process often mu…
Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awareness
Zhijie Shen, Zishuo Zheng, Chunyu Lin +4
Based on the Manhattan World assumption, most existing indoor layout estimation schemes focus on recovering layouts from vertically compressed 1D sequences. However, the compressio…
Deep Learning for Camera Calibration and Beyond: A Survey
Kang Liao, Lang Nie, Shujuan Huang +5
Camera calibration involves estimating camera parameters to infer geometric features from captured sequences, which is crucial for computer vision and robotics. However, convention…
Unsupervised OmniMVS: Efficient Omnidirectional Depth Inference via Establishing Pseudo-Stereo Supervision
Zisong Chen, Chunyu Lin, Lang Nie +2
Omnidirectional multi-view stereo (MVS) vision is attractive for its ultra-wide field-of-view (FoV), enabling machines to perceive 360° 3D surroundings. However, the existing solut…
Spatiotemporal Deformation Perception for Fisheye Video Rectification
Shangrong Yang, Chunyu Lin, Kang Liao +1
Although the distortion correction of fisheye images has been extensively studied, the correction of fisheye videos is still an elusive challenge. For different frames of the fishe…
Parallax-Tolerant Unsupervised Deep Image Stitching
Lang Nie, Chunyu Lin, Kang Liao +2
Traditional image stitching approaches tend to leverage increasingly complex geometric features (point, line, edge, etc.) for better performance. However, these hand-crafted featur…
Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization
Shangrong Yang, Chunyu Lin, Kang Liao +1
Fisheye image rectification has a long-term unresolved issue with synthetic-to-real generalization. In most previous works, the model trained on the synthetic images obtains unsati…
RecRecNet: Rectangling Rectified Wide-Angle Images by Thin-Plate Spline Model and DoF-based Curriculum Learning
Kang Liao, Lang Nie, Chunyu Lin +2
The wide-angle lens shows appealing applications in VR technologies, but it introduces severe radial distortion into its captured image. To recover the realistic scene, previous wo…
Neural Contourlet Network for Monocular 360 Depth Estimation
Zhijie Shen, Chunyu Lin, Lang Nie +2
For a monocular 360 image, depth estimation is a challenging because the distortion increases along the latitude. To perceive the distortion, existing methods devote to designing a…