201 citations · 425 across the 18 of their papers we have counts for
18 papers · 1 filter
Nerfels: Renderable Neural Codes for Improved Camera Pose Estimation
Gil Avraham, Julian Straub, Tianwei Shen +7
This paper presents a framework that combines traditional keypoint-based camera pose optimization with an invertible neural rendering mechanism. Our proposed 3D scene representatio…
NinjaDesc: Content-Concealing Visual Descriptors via Adversarial Learning
Tony Ng, Hyo Jin Kim, Vincent Lee +7
In the light of recent analyses on privacy-concerning scene revelation from visual descriptors, we develop descriptors that conceal the input image content. In particular, we propo…
Analysis and Mitigations of Reverse Engineering Attacks on Local Feature Descriptors
Deeksha Dangwal, Vincent T. Lee, Hyo Jin Kim +9
As autonomous driving and augmented reality evolve, a practical concern is data privacy. In particular, these applications rely on localization based on user images. The widely ado…
Domain Adaptation of Learned Features for Visual Localization
Sungyong Baik, Hyo Jin Kim, Tianwei Shen +3
We tackle the problem of visual localization under changing conditions, such as time of day, weather, and seasons. Recent learned local features based on deep neural networks have…
Learning Stereo Matchability in Disparity Regression Networks
Jingyang Zhang, Yao Yao, Zixin Luo +4
Learning-based stereo matching has recently achieved promising results, yet still suffers difficulties in establishing reliable matches in weakly matchable regions that are texture…
Stochastic Bundle Adjustment for Efficient and Scalable 3D Reconstruction
Lei Zhou, Zixin Luo, Mingmin Zhen +5
Current bundle adjustment solvers such as the Levenberg-Marquardt (LM) algorithm are limited by the bottleneck in solving the Reduced Camera System (RCS) whose dimension is proport…
Self-Supervised Monocular 3D Face Reconstruction by Occlusion-Aware Multi-view Geometry Consistency
Jiaxiang Shang, Tianwei Shen, Shiwei Li +4
Recent learning-based approaches, in which models are trained by single-view images have shown promising results for monocular 3D face reconstruction, but they suffer from the ill-…
Joint Semantic Segmentation and Boundary Detection using Iterative Pyramid Contexts
Mingmin Zhen, Jinglu Wang, Lei Zhou +5
In this paper, we present a joint multi-task learning framework for semantic segmentation and boundary detection. The critical component in the framework is the iterative pyramid c…
KFNet: Learning Temporal Camera Relocalization using Kalman Filtering
Lei Zhou, Zixin Luo, Tianwei Shen +5
Temporal camera relocalization estimates the pose with respect to each video frame in sequence, as opposed to one-shot relocalization which focuses on a still image. Even though th…
Self-Supervised Learning of Depth and Motion Under Photometric Inconsistency
Tianwei Shen, Lei Zhou, Zixin Luo +5
The self-supervised learning of depth and pose from monocular sequences provides an attractive solution by using the photometric consistency of nearby frames as it depends much les…
Learning Two-View Correspondences and Geometry Using Order-Aware Network
Jiahui Zhang, Dawei Sun, Zixin Luo +6
Establishing correspondences between two images requires both local and global spatial context. Given putative correspondences of feature points in two views, in this paper, we pro…
ContextDesc: Local Descriptor Augmentation with Cross-Modality Context
Zixin Luo, Tianwei Shen, Lei Zhou +5
Most existing studies on learning local features focus on the patch-based descriptions of individual keypoints, whereas neglecting the spatial relations established from their keyp…
Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference
Yao Yao, Zixin Luo, Shiwei Li +3
Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: t…
Beyond Photometric Loss for Self-Supervised Ego-Motion Estimation
Tianwei Shen, Zixin Luo, Lei Zhou +4
Accurate relative pose is one of the key components in visual odometry (VO) and simultaneous localization and mapping (SLAM). Recently, the self-supervised learning framework that…
Matchable Image Retrieval by Learning from Surface Reconstruction
Tianwei Shen, Zixin Luo, Lei Zhou +4
Convolutional Neural Networks (CNNs) have achieved superior performance on object image retrieval, while Bag-of-Words (BoW) models with handcrafted local features still dominate th…
GeoDesc: Learning Local Descriptors by Integrating Geometry Constraints
Zixin Luo, Tianwei Shen, Lei Zhou +5
Learned local descriptors based on Convolutional Neural Networks (CNNs) have achieved significant improvements on patch-based benchmarks, whereas not having demonstrated strong gen…
Learning and Matching Multi-View Descriptors for Registration of Point Clouds
Lei Zhou, Siyu Zhu, Zixin Luo +5
Critical to the registration of point clouds is the establishment of a set of accurate correspondences between points in 3D space. The correspondence problem is generally addressed…
Parallel Structure from Motion from Local Increment to Global Averaging
Siyu Zhu, Tianwei Shen, Lei Zhou +4
In this paper, we tackle the accurate and consistent Structure from Motion (SfM) problem, in particular camera registration, far exceeding the memory of a single computer in parall…