74 citations · 287 across the 43 of their papers we have counts for
44 papers
Puffin-World: Scaling a Unified Multimodal Model with Native 3D World States
Kang Liao, Yihang Luo, Xiao-Ming Wu +7
We propose Puffin-World, a unified multimodal architecture that integrates physical understanding, spatial simulation, and 3D world generation and reconstruction without relying on…
StructDiff: A Structure-Preserving and Spatially Controllable Diffusion Model for Single-Image Generation
Yinxi He, Kang Liao, Chunyu Lin +2
This paper introduces StructDiff, a generative framework based on a single-scale diffusion model for single-image generation. Single-image generation aims to synthesize diverse sam…
Advancing Real-World Parking Slot Detection with Large-Scale Dataset and Semi-Supervised Baseline
Zhihao Zhang, Chunyu Lin, Lang Nie +2
As automatic parking systems evolve, the accurate detection of parking slots has become increasingly critical. This study focuses on parking slot detection using surround-view came…
From Editor to Dense Geometry Estimator
JiYuan Wang, Chunyu Lin, Lei Sun +5
Leveraging visual priors from pre-trained text-to-image (T2I) generative models has shown success in dense prediction. However, dense prediction is inherently an image-to-image tas…
StabStitch++: Unsupervised Online Video Stitching with Spatiotemporal Bidirectional Warps
Lang Nie, Chunyu Lin, Kang Liao +3
We retarget video stitching to an emerging issue, named warping shake, which unveils the temporal content shakes induced by sequentially unsmooth warps when extending image stitchi…
You Need a Transition Plane: Bridging Continuous Panoramic 3D Reconstruction with Perspective Gaussian Splatting
Zhijie Shen, Chunyu Lin, Shujuan Huang +3
Recently, reconstructing scenes from a single panoramic image using advanced 3D Gaussian Splatting (3DGS) techniques has attracted growing interest. Panoramic images offer a 360$\t…
Semi-Supervised 360 Layout Estimation with Panoramic Collaborative Perturbations
Junsong Zhang, Chunyu Lin, Zhijie Shen +3
The performance of existing supervised layout estimation methods heavily relies on the quality of data annotations. However, obtaining large-scale and high-quality datasets remains…
Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation
Jiyuan Wang, Chunyu Lin, Cheng Guan +5
In this paper, we propose Jasmine, the first Stable Diffusion (SD)-based self-supervised framework for monocular depth estimation, which effectively harnesses SD's visual priors to…
What Really Matters for Learning-based LiDAR-Camera Calibration
Shujuan Huang, Chunyu Lin, Yao Zhao
Calibration is an essential prerequisite for the accurate data fusion of LiDAR and camera sensors. Traditional calibration techniques often require specific targets or suitable sce…
Revisiting Monocular 3D Object Detection with Depth Thickness Field
Qiude Zhang, Chunyu Lin, Zhijie Shen +2
Monocular 3D object detection is challenging due to the lack of accurate depth. However, existing depth-assisted solutions still exhibit inferior performance, whose reason is unive…
Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph
Zherong Zhang, Chunyu Lin, Shujuan Huang +2
Relative pose estimation is crucial for various computer vision applications, including Robotic and Autonomous Driving. Current methods primarily depend on selecting and matching f…
SGFormer: Spherical Geometry Transformer for 360 Depth Estimation
Junsong Zhang, Zisong Chen, Chunyu Lin +5
Panoramic distortion poses a significant challenge in 360 depth estimation, particularly pronounced at the north and south poles. Existing methods either adopt a bi-projection fusi…
Digging into contrastive learning for robust depth estimation with diffusion models
Jiyuan Wang, Chunyu Lin, Lang Nie +3
Recently, diffusion-based depth estimation methods have drawn widespread attention due to their elegant denoising patterns and promising performance. However, they are typically un…
Eliminating Warping Shakes for Unsupervised Online Video Stitching
Lang Nie, Chunyu Lin, Kang Liao +4
In this paper, we retarget video stitching to an emerging issue, named warping shake, when extending image stitching to video stitching. It unveils the temporal instability of warp…
Semi-Supervised Coupled Thin-Plate Spline Model for Rotation Correction and Beyond
Lang Nie, Chunyu Lin, Kang Liao +2
Thin-plate spline (TPS) is a principal warp that allows for representing elastic, nonlinear transformation with control point motions. With the increase of control points, the warp…
Camera calibration for the surround-view system: a benchmark and dataset
L Qin, C Lin, S Huang +2
Surround-view system (SVS) is widely used in the Advanced Driver Assistance System (ADAS). SVS uses four fisheye lenses to monitor real-time scenes around the vehicle. However, acc…
360 Layout Estimation via Orthogonal Planes Disentanglement and Multi-view Geometric Consistency Perception
Zhijie Shen, Chunyu Lin, Junsong Zhang +3
Existing panoramic layout estimation solutions tend to recover room boundaries from a vertically compressed sequence, yielding imprecise results as the compression process often mu…
WeatherDepth: Curriculum Contrastive Learning for Self-Supervised Depth Estimation under Adverse Weather Conditions
Jiyuan Wang, Chunyu Lin, Lang Nie +4
Depth estimation models have shown promising performance on clear scenes but fail to generalize to adverse weather conditions due to illumination variations, weather particles, etc…
SigVIC: Spatial Importance Guided Variable-Rate Image Compression
Jiaming Liang, Meiqin Liu, Chao Yao +2
Variable-rate mechanism has improved the flexibility and efficiency of learning-based image compression that trains multiple models for different rate-distortion tradeoffs. One of…
Disentangling Orthogonal Planes for Indoor Panoramic Room Layout Estimation with Cross-Scale Distortion Awareness
Zhijie Shen, Zishuo Zheng, Chunyu Lin +4
Based on the Manhattan World assumption, most existing indoor layout estimation schemes focus on recovering layouts from vertically compressed 1D sequences. However, the compressio…
Deep Learning for Camera Calibration and Beyond: A Survey
Kang Liao, Lang Nie, Shujuan Huang +5
Camera calibration involves estimating camera parameters to infer geometric features from captured sequences, which is crucial for computer vision and robotics. However, convention…
Unsupervised OmniMVS: Efficient Omnidirectional Depth Inference via Establishing Pseudo-Stereo Supervision
Zisong Chen, Chunyu Lin, Lang Nie +2
Omnidirectional multi-view stereo (MVS) vision is attractive for its ultra-wide field-of-view (FoV), enabling machines to perceive 360° 3D surroundings. However, the existing solut…
Spatiotemporal Deformation Perception for Fisheye Video Rectification
Shangrong Yang, Chunyu Lin, Kang Liao +1
Although the distortion correction of fisheye images has been extensively studied, the correction of fisheye videos is still an elusive challenge. For different frames of the fishe…
Parallax-Tolerant Unsupervised Deep Image Stitching
Lang Nie, Chunyu Lin, Kang Liao +2
Traditional image stitching approaches tend to leverage increasingly complex geometric features (point, line, edge, etc.) for better performance. However, these hand-crafted featur…