46 citations · 149 across the 35 of their papers we have counts for
31 papers · 1 filter
Digging Into Normal Incorporated Stereo Matching
Zihua Liu, Songyan Zhang, Zhicheng Wang +1
Despite the remarkable progress facilitated by learning-based stereo-matching algorithms, disparity estimation in low-texture, occluded, and bordered regions still remains a bottle…
EMR-MSF: Self-Supervised Recurrent Monocular Scene Flow Exploiting Ego-Motion Rigidity
Zijie Jiang, Masatoshi Okutomi
Self-supervised monocular scene flow estimation, aiming to understand both 3D structures and 3D motions from two temporally consecutive monocular images, has received increasing at…
Polarimetric Multi-View Inverse Rendering
Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) and the degree of polarization (DoP) of reflected light are related to an obje…
Dual-Pixel Raindrop Removal
Yizhou Li, Yusuke Monno, Masatoshi Okutomi
Removing raindrops in images has been addressed as a significant task for various computer vision applications. In this paper, we propose the first method using a Dual-Pixel (DP) s…
Deep Hyperspectral-Depth Reconstruction Using Single Color-Dot Projection
Chunyu Li, Yusuke Monno, Masatoshi Okutomi
Depth reconstruction and hyperspectral reflectance reconstruction are two active research topics in computer vision and image processing. Conventionally, these two topics have been…
Self-Supervised Ego-Motion Estimation Based on Multi-Layer Fusion of RGB and Inferred Depth
Zijie Jiang, Hajime Taira, Naoyuki Miyashita +1
In existing self-supervised depth and ego-motion estimation methods, ego-motion estimation is usually limited to only leveraging RGB information. Recently, several methods have bee…
Single Image Deraining Network with Rain Embedding Consistency and Layered LSTM
Yizhou Li, Yusuke Monno, Masatoshi Okutomi
Single image deraining is typically addressed as residual learning to predict the rain layer from an input rainy image. For this purpose, an encoder-decoder network draws wide atte…
Learning-Based Depth and Pose Estimation for Monocular Endoscope with Loss Generalization
Aji Resindra Widya, Yusuke Monno, Masatoshi Okutomi +3
Gastroendoscopy has been a clinical standard for diagnosing and treating conditions that affect a part of a patient's digestive system, such as the stomach. Despite the fact that g…
Multi-Modal Pedestrian Detection with Large Misalignment Based on Modal-Wise Regression and Multi-Modal IoU
Napat Wanchaitanawong, Masayuki Tanaka, Takashi Shibata +1
The combined use of multiple modalities enables accurate pedestrian detection under poor lighting conditions by using the high visibility areas from these modalities together. The…
Geometric Data Augmentation Based on Feature Map Ensemble
Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
Deep convolutional networks have become the mainstream in computer vision applications. Although CNNs have been successful in many computer vision tasks, it is not free from drawba…
Video-Based Camera Localization Using Anchor View Detection and Recursive 3D Reconstruction
Hajime Taira, Koki Onbe, Naoyuki Miyashita +1
In this paper we introduce a new camera localization strategy designed for image sequences captured in challenging industrial situations such as industrial parts inspection. To dea…
Spectral MVIR: Joint Reconstruction of 3D Shape and Spectral Reflectance
Chunyu Li, Yusuke Monno, Masatoshi Okutomi
Reconstructing an object's high-quality 3D shape with inherent spectral reflectance property, beyond typical device-dependent RGB albedos, opens the door to applications requiring…
VIO-Aided Structure from Motion Under Challenging Environments
Zijie Jiang, Hajime Taira, Naoyuki Miyashita +1
In this paper, we present a robust and efficient Structure from Motion pipeline for accurate 3D reconstruction under challenging environments by leveraging the camera pose informat…
Deep Snapshot HDR Imaging Using Multi-Exposure Color Filter Array
Takeru Suda, Masayuki Tanaka, Yusuke Monno +1
In this paper, we propose a deep snapshot high dynamic range (HDR) imaging framework that can effectively reconstruct an HDR image from the RAW data captured using a multi-exposure…
Adaptive Future Frame Prediction with Ensemble Network
Wonjik Kim, Masayuki Tanaka, Masatoshi Okutomi +1
Future frame prediction in videos is a challenging problem because videos include complicated movements and large appearance changes. Learning-based future frame prediction approac…
Human Segmentation with Dynamic LiDAR Data
Tao Zhong, Wonjik Kim, Masayuki Tanaka +1
Consecutive LiDAR scans compose dynamic 3D sequences, which contain more abundant information than a single frame. Similar to the development history of image and video perception,…
Polarimetric Multi-View Inverse Rendering
Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal. In this paper, we…
3D Pipe Network Reconstruction Based on Structure from Motion with Incremental Conic Shape Detection and Cylindrical Constraint
Sho kagami, Hajime Taira, Naoyuki Miyashita +2
Pipe inspection is a critical task for many industries and infrastructure of a city. The 3D information of a pipe can be used for revealing the deformation of the pipe surface and…
Classifying degraded images over various levels of degradation
Kazuki Endo, Masayuki Tanaka, Masatoshi Okutomi
Classification for degraded images having various levels of degradation is very important in practical applications. This paper proposes a convolutional neural network to classify…
Stomach 3D Reconstruction Based on Virtual Chromoendoscopic Image Generation
Aji Resindra Widya, Yusuke Monno, Masatoshi Okutomi +3
Gastric endoscopy is a standard clinical process that enables medical practitioners to diagnose various lesions inside a patient's stomach. If any lesion is found, it is very impor…
Learning-Based Human Segmentation and Velocity Estimation Using Automatic Labeled LiDAR Sequence for Training
Wonjik Kim, Masayuki Tanaka, Masatoshi Okutomi +1
In this paper, we propose an automatic labeled sequential data generation pipeline for human segmentation and velocity estimation with point clouds. Considering the impact of deep…
Is This The Right Place? Geometric-Semantic Pose Verification for Indoor Visual Localization
Hajime Taira, Ignacio Rocco, Jiri Sedlar +5
Visual localization in large and complex indoor scenes, dominated by weakly textured rooms and repeating geometric patterns, is a challenging problem with high practical relevance…
Pro-Cam SSfM: Projector-Camera System for Structure and Spectral Reflectance from Motion
Chunyu Li, Yusuke Monno, Hironori Hidaka +1
In this paper, we propose a novel projector-camera system for practical and low-cost acquisition of a dense object 3D model with the spectral reflectance property. In our system, w…
3D Reconstruction of Whole Stomach from Endoscope Video Using Structure-from-Motion
Aji Resindra Widya, Yusuke Monno, Kosuke Imahori +4
Gastric endoscopy is a common clinical practice that enables medical doctors to diagnose the stomach inside a body. In order to identify a gastric lesion's location such as early g…