31 citations · 50 across the 27 of their papers we have counts for
27 papers
Action Motifs: Self-Supervised Hierarchical Representation of Human Body Movements
Genki Kinoshita, Shu Nakamura, Ryo Kawahara +3
Effective human behavior modeling requires a representation of the human body movement that capitalizes on its compositionality. We propose a hierarchical representation consisting…
REACH: Hand Pose Estimation from Room Corners
Shu Nakamura, Ryo Kawahara, Genki Kinoshita +4
We introduce a novel 3D hand pose estimator that can accurately recover the shape and pose of people's hands in a room from afar, typically from fixed cameras at room corners, in e…
SteerPose: Simultaneous Extrinsic Camera Calibration and Matching from Articulation
Sang-Eun Lee, Ko Nishino, Shohei Nobuhara
Can freely moving humans or animals themselves serve as calibration targets for multi-camera systems while simultaneously estimating their correspondences across views? We humans c…
Physical Plausibility-aware Trajectory Prediction via Locomotion Embodiment
Hiromu Taketsugu, Takeru Oba, Takahiro Maeda +2
Humans can predict future human trajectories even from momentary observations by using human pose-related cues. However, previous Human Trajectory Prediction (HTP) methods leverage…
Spatiotemporal Multi-Camera Calibration using Freely Moving People
Sang-Eun Lee, Ko Nishino, Shohei Nobuhara
We propose a novel method for spatiotemporal multi-camera calibration using freely moving people in multiview videos. Since calibrating multiple cameras and finding matches across…
RatBodyFormer: Rat Body Surface from Keypoints
Ayaka Higami, Karin Oshima, Tomoyo Isoguchi Shiramatsu +3
Analyzing rat behavior lies at the heart of many scientific studies. Past methods for automated rodent modeling have focused on 3D pose estimation from keypoints, e.g., face and ap…
KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter
Yifan Zhan, Zhuoxiao Li, Muyao Niu +4
We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea i…
SPIDeRS: Structured Polarization for Invisible Depth and Reflectance Sensing
Tomoki Ichikawa, Shohei Nobuhara, Ko Nishino
Can we capture shape and reflectance in stealth? Such capability would be valuable for many application domains in vision, xR, robotics, and HCI. We introduce structured polarizati…
DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lighting
Kohei Yamashita, Shohei Nobuhara, Ko Nishino
Geometry reconstruction of textureless, non-Lambertian objects under unknown natural illumination (i.e., in the wild) remains challenging as correspondences cannot be established a…
DeePoint: Visual Pointing Recognition and Direction Estimation
Shu Nakamura, Yasutomo Kawanishi, Shohei Nobuhara +1
In this paper, we realize automatic visual recognition and direction estimation of pointing. We introduce the first neural pointing understanding method based on two key contributi…
TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimation
Yuta Yoshitake, Mai Nishimura, Shohei Nobuhara +1
We propose a novel method for joint estimation of shape and pose of rigid objects from their sequentially observed RGB-D images. In sharp contrast to past approaches that rely on c…
InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Views
Mai Nishimura, Shohei Nobuhara, Ko Nishino
We introduce an on-ground Pedestrian World Model, a computational model that can predict how pedestrians move around an observer in the crowd on the ground plane, but from just the…
Fooling Polarization-based Vision using Locally Controllable Polarizing Projection
Zhuoxiao Li, Zhihang Zhong, Shohei Nobuhara +2
Polarization is a fundamental property of light that encodes abundant information regarding surface shape, material, illumination and viewing geometry. The computer vision communit…
Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection
Tomoki Ichikawa, Yoshiki Fukao, Shohei Nobuhara +1
Computer vision applications have heavily relied on the linear combination of Lambertian diffuse and microfacet specular reflection models for representing reflected radiance, whic…
ViewBirdiformer: Learning to recover ground-plane crowd trajectories and ego-motion from a single ego-centric view
Mai Nishimura, Shohei Nobuhara, Ko Nishino
We introduce a novel learning-based method for view birdification, the task of recovering ground-plane trajectories of pedestrians of a crowd and their observer in the same crowd j…
BlindSpotNet: Seeing Where We Cannot See
Taichi Fukuda, Kotaro Hasegawa, Shinya Ishizaki +2
We introduce 2D blind spot estimation as a critical visual task for road scene understanding. By automatically detecting road regions that are occluded from the vehicle's vantage p…
nLMVS-Net: Deep Non-Lambertian Multi-View Stereo
Kohei Yamashita, Yuto Enyo, Shohei Nobuhara +1
We introduce a novel multi-view stereo (MVS) method that can simultaneously recover not just per-pixel depth but also surface normals, together with the reflectance of textureless,…
View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements
Mai Nishimura, Shohei Nobuhara, Ko Nishino
We introduce view birdification, the problem of recovering ground-plane movements of people in a crowd from an ego-centric video captured from an observer (e.g., a person or a vehi…
Structure of Multiple Mirror System from Kaleidoscopic Projections of Single 3D Point
Kosuke Takahashi, Shohei Nobuhara
This paper proposes a novel algorithm of discovering the structure of a kaleidoscopic imaging system that consists of multiple planar mirrors and a camera. The kaleidoscopic imagin…
Video Region Annotation with Sparse Bounding Boxes
Yuzheng Xu, Yang Wu, Nur Sabrina binti Zuraimi +2
Video analysis has been moving towards more detailed interpretation (e.g. segmentation) with encouraging progresses. These tasks, however, increasingly rely on densely annotated tr…
Invertible Neural BRDF for Object Inverse Rendering
Zhe Chen, Shohei Nobuhara, Ko Nishino
We introduce a novel neural network-based BRDF model and a Bayesian framework for object inverse rendering, i.e., joint estimation of reflectance and natural illumination from a si…
SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera
Weimin Wang, Shohei Nobuhara, Ryosuke Nakamura +1
This paper presents a novel semantic-based online extrinsic calibration approach, SOIC (so, I see), for Light Detection and Ranging (LiDAR) and camera sensors. Previous online cali…
3D-GMNet: Single-View 3D Shape Recovery as A Gaussian Mixture
Kohei Yamashita, Shohei Nobuhara, Ko Nishino
In this paper, we introduce 3D-GMNet, a deep neural network for 3D object shape reconstruction from a single image. As the name suggests, 3D-GMNet recovers 3D shape as a Gaussian m…
Appearance and Shape from Water Reflection
Ryo Kawahara, Meng-Yu Jennifer Kuo, Shohei Nobuhara +1
This paper introduces single-image geometric and appearance reconstruction from water reflection photography, i.e., images capturing direct and water-reflected real-world scenes. W…