7 papers
Action Motifs: Self-Supervised Hierarchical Representation of Human Body Movements
Genki Kinoshita, Shu Nakamura, Ryo Kawahara +3
Effective human behavior modeling requires a representation of the human body movement that capitalizes on its compositionality. We propose a hierarchical representation consisting…
SteerPose: Simultaneous Extrinsic Camera Calibration and Matching from Articulation
Sang-Eun Lee, Ko Nishino, Shohei Nobuhara
Can freely moving humans or animals themselves serve as calibration targets for multi-camera systems while simultaneously estimating their correspondences across views? We humans c…
Spatiotemporal Multi-Camera Calibration using Freely Moving People
Sang-Eun Lee, Ko Nishino, Shohei Nobuhara
We propose a novel method for spatiotemporal multi-camera calibration using freely moving people in multiview videos. Since calibrating multiple cameras and finding matches across…
RatBodyFormer: Rat Body Surface from Keypoints
Ayaka Higami, Karin Oshima, Tomoyo Isoguchi Shiramatsu +3
Analyzing rat behavior lies at the heart of many scientific studies. Past methods for automated rodent modeling have focused on 3D pose estimation from keypoints, e.g., face and ap…
KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter
Yifan Zhan, Zhuoxiao Li, Muyao Niu +4
We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea i…
SPIDeRS: Structured Polarization for Invisible Depth and Reflectance Sensing
Tomoki Ichikawa, Shohei Nobuhara, Ko Nishino
Can we capture shape and reflectance in stealth? Such capability would be valuable for many application domains in vision, xR, robotics, and HCI. We introduce structured polarizati…
DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lighting
Kohei Yamashita, Shohei Nobuhara, Ko Nishino
Geometry reconstruction of textureless, non-Lambertian objects under unknown natural illumination (i.e., in the wild) remains challenging as correspondences cannot be established a…